-- Logs begin at Sat 2022-06-18 03:04:32 UTC, end at Sat 2022-06-18 04:10:40 UTC. -- Jun 18 04:04:10.313563 dv-cinder-836996-34-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 18 04:04:10.326286 dv-cinder-836996-34-iscsi devstack@keystone.service[80230]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 18 04:04:10.326286 dv-cinder-836996-34-iscsi devstack@keystone.service[80230]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Jun 18 04:04:10 2022] *** Jun 18 04:04:10.326286 dv-cinder-836996-34-iscsi devstack@keystone.service[80230]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 18 04:04:10.326286 dv-cinder-836996-34-iscsi devstack@keystone.service[80230]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 18 04:04:10.326286 dv-cinder-836996-34-iscsi devstack@keystone.service[80230]: nodename: dv-cinder-836996-34-iscsi Jun 18 04:04:10.326286 dv-cinder-836996-34-iscsi devstack@keystone.service[80230]: machine: x86_64 Jun 18 04:04:10.326286 dv-cinder-836996-34-iscsi devstack@keystone.service[80230]: clock source: unix Jun 18 04:04:10.326286 dv-cinder-836996-34-iscsi devstack@keystone.service[80230]: pcre jit disabled Jun 18 04:04:10.326286 dv-cinder-836996-34-iscsi devstack@keystone.service[80230]: detected number of CPU cores: 4 Jun 18 04:04:10.326286 dv-cinder-836996-34-iscsi devstack@keystone.service[80230]: current working directory: / Jun 18 04:04:10.326286 dv-cinder-836996-34-iscsi devstack@keystone.service[80230]: detected binary path: /usr/bin/uwsgi-core Jun 18 04:04:10.326286 dv-cinder-836996-34-iscsi devstack@keystone.service[80230]: your processes number limit is 47680 Jun 18 04:04:10.326286 dv-cinder-836996-34-iscsi devstack@keystone.service[80230]: your memory page size is 4096 bytes Jun 18 04:04:10.326286 dv-cinder-836996-34-iscsi devstack@keystone.service[80230]: detected max file descriptor number: 2048 Jun 18 04:04:10.326286 dv-cinder-836996-34-iscsi devstack@keystone.service[80230]: lock engine: pthread robust mutexes Jun 18 04:04:10.326286 dv-cinder-836996-34-iscsi devstack@keystone.service[80230]: thunder lock: enabled Jun 18 04:04:10.326286 dv-cinder-836996-34-iscsi devstack@keystone.service[80230]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 18 04:04:10.326286 dv-cinder-836996-34-iscsi devstack@keystone.service[80230]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 18 04:04:10.367922 dv-cinder-836996-34-iscsi devstack@keystone.service[80230]: Python main interpreter initialized at 0x555e798169c0 Jun 18 04:04:10.367922 dv-cinder-836996-34-iscsi devstack@keystone.service[80230]: python threads support enabled Jun 18 04:04:10.367922 dv-cinder-836996-34-iscsi devstack@keystone.service[80230]: your server socket listen backlog is limited to 100 connections Jun 18 04:04:10.367922 dv-cinder-836996-34-iscsi devstack@keystone.service[80230]: your mercy for graceful operations on workers is 90 seconds Jun 18 04:04:10.368250 dv-cinder-836996-34-iscsi devstack@keystone.service[80230]: mapped 403077 bytes (393 KB) for 2 cores Jun 18 04:04:10.368318 dv-cinder-836996-34-iscsi devstack@keystone.service[80230]: *** Operational MODE: preforking *** Jun 18 04:04:10.368619 dv-cinder-836996-34-iscsi devstack@keystone.service[80230]: *** uWSGI is running in multiple interpreter mode *** Jun 18 04:04:10.368619 dv-cinder-836996-34-iscsi devstack@keystone.service[80230]: spawned uWSGI master process (pid: 80230) Jun 18 04:04:10.368809 dv-cinder-836996-34-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 18 04:04:10.372136 dv-cinder-836996-34-iscsi devstack@keystone.service[80230]: spawned uWSGI worker 1 (pid: 80240, cores: 1) Jun 18 04:04:10.372136 dv-cinder-836996-34-iscsi devstack@keystone.service[80230]: spawned uWSGI worker 2 (pid: 80241, cores: 1) Jun 18 04:04:10.372136 dv-cinder-836996-34-iscsi devstack@keystone.service[80230]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 18 04:04:15.725487 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 18 04:04:15.725487 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: from cryptography.utils import int_from_bytes Jun 18 04:04:15.726327 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 18 04:04:15.726327 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: from cryptography.utils import int_from_bytes Jun 18 04:04:15.726327 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 18 04:04:15.726327 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: from cryptography.utils import int_from_bytes Jun 18 04:04:15.726818 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 18 04:04:15.726818 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: from cryptography.utils import int_from_bytes Jun 18 04:04:15.774670 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 18 04:04:15.774890 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 18 04:04:15.775046 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] command line args: [] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 18 04:04:15.775193 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 18 04:04:15.775282 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 18 04:04:15.775362 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 18 04:04:15.775442 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ================================================================================ {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 18 04:04:15.775522 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] command line args: [] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 18 04:04:15.775709 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] admin_token = **** {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.775844 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 18 04:04:15.775926 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] config_dir = [] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.775987 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ================================================================================ {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 18 04:04:15.776178 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.776302 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] admin_token = **** {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.776381 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] config_source = [] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.776451 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] config_dir = [] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.776536 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] debug = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.776666 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.776748 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.776988 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] config_source = [] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.776988 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] debug = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.777121 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.777191 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.777275 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.777379 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.777510 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.777583 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.777652 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.777818 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.777905 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] list_limit = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.778040 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.778117 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] log_config_append = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.778239 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.778328 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] list_limit = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.778394 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] log_dir = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.778457 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] log_config_append = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.778604 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] log_file = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.778681 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.778739 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] log_dir = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.778806 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.778864 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] log_file = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.779029 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.779113 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.779238 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.779323 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.779488 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.779577 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.779641 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.779780 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.779859 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.779928 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.780082 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.780169 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.780371 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.780507 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.780609 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.780690 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.780752 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.780816 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.780987 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.781079 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.781257 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.781396 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.781474 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.781533 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.781666 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.781755 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.781932 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.782066 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.782168 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.782462 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.782592 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] publish_errors = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.782692 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.782823 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] publish_errors = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.782999 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.783166 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.783349 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.783488 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.783624 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.783624 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.783750 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.783750 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.783974 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.784035 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] standard_threads = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.784092 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.784261 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.784341 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] standard_threads = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.784341 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.784523 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.784523 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.784666 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.784732 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] use_journal = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.784790 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.784857 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] use_json = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.785084 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] use_journal = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.785197 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] use_stderr = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.785305 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] use_json = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.785420 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] use_syslog = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.785539 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] use_stderr = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.785539 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] use_syslog = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.785763 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.785876 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 04:04:15.785995 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.786106 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.786253 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.786374 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.786485 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.786601 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.786711 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.786828 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.786953 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.787065 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.787180 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.787290 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.787399 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.787507 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.787625 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.787735 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.787850 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.787961 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.788070 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.788070 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.788282 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.788393 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.788502 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.788638 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.788751 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.788889 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.789012 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.789124 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.789246 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.789364 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.789475 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.789584 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.789773 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.789886 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.790003 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.790116 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.790225 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.790334 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.790451 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.790569 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.790679 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.790788 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.790897 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.791006 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.791124 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.791234 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.791343 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.791458 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.791568 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.791678 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.791795 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.791908 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.792017 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.792192 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.792315 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.792433 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.792553 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.792684 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.792794 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.792904 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.793013 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.793139 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.793253 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.793362 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.793471 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.793580 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.793689 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.793818 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.793930 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.794073 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.794224 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.794336 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.794445 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.794566 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.794678 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.794787 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.794902 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.795014 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.795123 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.795312 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.795431 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.795541 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.795653 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.795769 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.795880 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.795997 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.796108 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.796217 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.796329 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.796438 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.796553 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.796697 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.796819 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.796934 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.797044 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.797138 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.797237 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.797338 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.797439 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.797539 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.797634 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.797726 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.797818 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.797918 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.798020 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.798113 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.798213 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.798311 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.798456 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.798581 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.798693 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.798810 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.798922 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.799038 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.799152 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.799270 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.799381 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.799483 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.799599 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.799710 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.799826 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.799946 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.800065 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.800174 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.800295 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.800415 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.800528 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.800673 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.800793 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.800912 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.801024 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.801135 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.801245 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.801356 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.801467 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.801586 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.801698 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.801808 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.801918 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.802028 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.802138 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.802256 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.802368 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.802478 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.802596 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.802713 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.802833 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.802945 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.803056 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.803056 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.803255 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.803370 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.803490 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.803601 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.803712 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.803824 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.803939 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.804050 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.804168 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.804279 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.804398 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.804509 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.804633 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.804752 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.804879 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.804992 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.805102 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.805219 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.805330 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.805441 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.805560 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.805678 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.805791 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.805901 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.806012 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.806123 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.806311 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.806426 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.806545 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.806657 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.806774 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.806885 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.807011 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.807132 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.807257 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.807369 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.807479 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.807589 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.807699 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.807815 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.807938 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.808051 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.808160 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.808270 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.808380 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.808489 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.808678 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.808793 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.808914 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.809026 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.809137 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.809247 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.809366 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.809478 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.809589 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.809705 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.809817 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.809929 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.810047 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] auth.external = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.810160 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] auth.external = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.810314 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.810428 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.810539 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.810681 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.810805 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.810927 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.811076 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] auth.password = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.811191 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] auth.password = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.811303 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] auth.token = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.811415 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] auth.token = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.811527 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.811686 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.811799 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.811917 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.812032 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.812151 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.812265 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.812389 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.812503 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.812628 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.812742 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.812865 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.812979 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.813101 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.813205 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] credential.caching = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.813316 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] credential.caching = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.813428 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.813539 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.813651 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.813771 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.813771 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.813983 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.814101 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.814215 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.814326 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.814446 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.814559 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.814671 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.814783 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.814894 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.815006 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.815126 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.815240 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.815352 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.815463 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.815574 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.815685 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.815809 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.815921 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.816032 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.816143 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.816255 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.816366 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.816486 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.816641 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.816768 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.816882 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] federation.caching = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.816997 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] federation.caching = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.817109 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.817232 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.817347 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.817459 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.817577 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.817690 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.817801 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.817920 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.818104 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.818245 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.818361 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.818473 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.818585 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.818706 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.818820 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.818938 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.819052 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.819170 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.819284 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.819405 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.819524 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.819637 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.819749 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity.caching = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.819860 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.caching = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.819983 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.820174 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.820290 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.820403 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.820515 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.820647 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.820774 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.820889 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.821001 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.821113 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.821225 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.821336 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.821457 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.821571 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.821682 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.821794 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.821905 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.821905 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.822122 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.822234 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.822346 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.822457 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.822575 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.822688 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.822808 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.822921 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.823032 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.823143 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.823254 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.823418 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.823544 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.823660 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.823780 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.823780 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.823992 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.823992 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.824214 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.824334 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.824447 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.824558 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.824706 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.824819 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.824942 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.825057 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.825169 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.825280 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.825392 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.825503 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.825623 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.825738 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.825850 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.825962 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.826074 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.826186 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.826306 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.826419 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.826521 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.826631 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.826744 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.826855 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.826981 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.827095 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.827222 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.827335 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.827445 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.827556 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.827675 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.827796 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.827909 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.828020 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.828131 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.828242 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.828361 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.828474 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.828604 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.828718 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.828831 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.828942 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.829069 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.829183 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.829295 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.829405 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.829516 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.829626 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.829746 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.829860 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.829972 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.830082 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.830193 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.830304 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.830424 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.830536 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.830648 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.830759 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.830870 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.830981 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.831101 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.831213 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.831324 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.831436 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.831546 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.831657 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.831776 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.831888 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.832001 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.832112 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.832223 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.832342 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.832454 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.832565 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.832697 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.832808 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.832918 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.833042 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.833156 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.833266 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.833377 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.833488 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.833599 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.833721 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.833843 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.833953 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.834065 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.834175 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.834286 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.834405 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.834518 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.834629 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.834739 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.834850 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.834961 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.835080 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.835204 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.835330 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.835330 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.835538 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.835657 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.835775 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.835775 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.835992 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.835992 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.836211 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.836387 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.836535 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.836703 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.836818 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.836933 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.837046 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.837157 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.837286 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.837401 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.837513 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.837631 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.837744 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.837856 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.837975 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.838088 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.838200 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.838313 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.838424 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.838536 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.838656 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.838769 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.838880 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.838992 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.839109 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.839222 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.839343 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.839456 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.839567 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.839678 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.839789 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.839900 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] resource.caching = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.840023 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.840136 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.840248 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.840360 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.840472 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] resource.caching = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.840638 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.840766 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.840881 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.840993 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.841105 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.841216 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.841327 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.841448 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.841561 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.841672 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.841784 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.841895 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.842006 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.842189 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.842304 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] role.caching = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.842416 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.842528 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] role.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.842639 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.842750 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.842871 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] role.caching = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.842984 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.843095 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] role.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.843207 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.843319 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.843430 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.843551 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.843665 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.843776 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.843888 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.844000 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.844119 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.844232 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.844344 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.844455 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.844567 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.844699 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.844823 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.844937 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.845049 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.845160 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.845271 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.845383 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.845502 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.845617 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.845728 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.845839 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.845839 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.846050 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.846173 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.846286 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.846286 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.846495 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.846606 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.846717 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.846840 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.846953 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.847065 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.847177 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.847288 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.847400 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.847520 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.847632 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.847745 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.847857 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.847968 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.848079 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.848199 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.848312 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.848423 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.848534 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.848691 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.848804 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.848928 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.849042 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.849153 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.849265 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.849375 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.849494 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.849607 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.849718 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.849830 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.849940 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.850061 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.850182 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.850294 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] token.caching = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.850405 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.850516 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.850627 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.850738 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.850859 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] token.caching = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.850972 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.851083 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.851193 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.851304 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.851415 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.851534 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.851646 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.851758 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.851870 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.851982 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.852093 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.852212 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.852324 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.852435 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.852553 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.852686 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.852798 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.852928 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.853043 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.853155 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.853267 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.853377 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.853488 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.853607 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.853720 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.853831 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.853941 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.854053 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.854163 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.854282 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.854395 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.connection = **** {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.854516 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.854757 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.854881 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.854993 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.855107 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.connection = **** {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.855228 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.855349 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.855470 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.855584 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.855695 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.855695 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.855904 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.856022 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.856144 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.856257 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.856375 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.856495 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.856622 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.856736 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.856860 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.856979 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.857091 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.857203 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.857315 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.857426 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.857546 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.857666 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.857778 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.857889 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.858001 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.858112 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.858234 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.858347 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.858459 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.858570 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.858681 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.858793 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 18 04:04:15.858914 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.858914 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.858914 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 04:04:15.858914 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 18 04:04:15.887219 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 04:04:15.887483 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 04:04:15.887649 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 04:04:15.887738 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 04:04:15.887860 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 04:04:15.888103 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 04:04:15.896468 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 04:04:15.896718 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 04:04:15.924171 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 04:04:15.924404 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 04:04:15.924530 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 04:04:15.924635 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 04:04:16.074706 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 04:04:16.082548 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 04:04:16.124055 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 04:04:16.124283 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 04:04:16.127648 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 04:04:16.127887 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 04:04:16.187279 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 04:04:16.187474 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 04:04:16.187568 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 04:04:16.187722 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 04:04:16.187870 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 04:04:16.187954 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 04:04:16.188030 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 04:04:16.188101 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 04:04:16.188172 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 04:04:16.188344 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 04:04:16.188470 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 04:04:16.188609 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 04:04:16.213429 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 04:04:16.213573 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 04:04:16.213673 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 04:04:16.213752 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 04:04:16.213814 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 04:04:16.213927 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 04:04:16.214083 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 04:04:16.214236 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 04:04:16.214363 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 04:04:16.214440 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 04:04:16.214517 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 04:04:16.214629 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 04:04:16.214720 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 04:04:16.214845 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 04:04:16.225698 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 04:04:16.225930 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 04:04:16.238672 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 04:04:16.238944 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 04:04:16.239112 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 04:04:16.239193 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 04:04:16.239297 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 04:04:16.239359 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 04:04:16.239431 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 04:04:16.239513 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 04:04:16.239588 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 04:04:16.239650 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 04:04:16.239718 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 04:04:16.239865 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80240) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 04:04:16.239995 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 04:04:16.240090 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80241) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 04:04:16.257128 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.257338 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 18 04:04:16.257557 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.257683 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.257780 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 18 04:04:16.257869 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 18 04:04:16.258072 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.258208 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.258287 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 18 04:04:16.258363 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.258518 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.258643 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.258720 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.258794 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.258997 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.259246 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.269566 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.269841 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.270078 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.270208 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.270319 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.270443 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.270612 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.270886 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.278657 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 04:04:16.279204 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 04:04:16.281952 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 04:04:16.282225 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.282491 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 04:04:16.282617 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.282736 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.282848 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.283034 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.283158 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.283235 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.283309 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.283526 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.283652 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.283812 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.283938 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.284015 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.284090 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.284282 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.284376 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.284559 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.284712 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.284826 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.285102 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.310834 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.311712 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.312424 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 04:04:16.312713 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.313332 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 04:04:16.313605 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.317935 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 04:04:16.318319 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.318596 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.318816 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 04:04:16.319201 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.319476 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.325949 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 04:04:16.326169 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.327008 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 04:04:16.327281 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.330628 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 04:04:16.330903 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.331180 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.331455 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.331723 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.331848 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 04:04:16.331956 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.332045 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.332246 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.332372 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.332464 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.332541 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.332814 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.333081 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.333346 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.333596 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.353850 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.354322 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.356968 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.357437 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.360525 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 04:04:16.363064 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 04:04:16.364382 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.364805 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.366673 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.367068 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.369792 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 04:04:16.372101 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 04:04:16.373448 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 04:04:16.375691 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 04:04:16.377106 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.377398 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.377670 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.377947 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.378224 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.378496 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.379341 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.379634 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.379913 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.380188 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.380464 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.380737 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.397806 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 04:04:16.398089 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.398349 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.398613 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.399593 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 04:04:16.399877 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.400138 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.400406 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.406457 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.408149 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.408275 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.408391 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.409916 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.410188 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.411765 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 04:04:16.412087 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.412357 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.412674 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.412953 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.413383 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 04:04:16.413660 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.413901 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.414187 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.414462 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.426190 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 04:04:16.426463 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.426747 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.427020 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.427617 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 04:04:16.427868 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.428166 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.428411 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.428664 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.428952 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.429221 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.430091 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.430372 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.430652 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.447025 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 04:04:16.448567 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 04:04:16.450372 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 04:04:16.451855 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 04:04:16.453669 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.455137 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.455374 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.456853 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.457105 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 04:04:16.457335 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.457602 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.458482 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 04:04:16.458754 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.459032 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.464881 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.466427 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.466571 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 04:04:16.468017 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 04:04:16.469663 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.469954 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.470332 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.470606 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.471231 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.471512 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.471892 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.472165 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.479686 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 04:04:16.479972 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.480253 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.481288 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 04:04:16.481568 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.481837 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.488843 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80241) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 04:04:16.489115 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.489388 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.489656 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.489917 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.490041 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80240) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 04:04:16.490247 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.490371 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.490493 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.490586 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.490787 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.490937 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.491011 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.491096 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.491324 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.491507 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.491658 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.491843 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.491972 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.492100 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.492223 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.492351 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.492518 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80241) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.492628 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.492707 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.492942 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.493206 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.493458 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80240) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 04:04:16.530034 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555e798169c0 pid: 80241 (default app) Jun 18 04:04:16.530703 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555e798169c0 pid: 80240 (default app) Jun 18 04:04:16.533433 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95bcd7-32b0-475a-ac9b-ef67c7ea4650 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:16.533716 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95bcd7-32b0-475a-ac9b-ef67c7ea4650 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:16.533986 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95bcd7-32b0-475a-ac9b-ef67c7ea4650 None None] PATH_INFO: `/v3` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:16.538225 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 791 bytes} [Sat Jun 18 04:04:16 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:24.197533 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb941d9d-d254-4c08-9f01-28b0a88275dc None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:24.198137 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb941d9d-d254-4c08-9f01-28b0a88275dc None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:24.198137 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb941d9d-d254-4c08-9f01-28b0a88275dc None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:24.202473 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 1/2] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:04:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 18 04:04:24.209248 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e15ee-7244-4b99-979f-29a9045b4108 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:24.209947 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e15ee-7244-4b99-979f-29a9045b4108 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:24.210092 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e15ee-7244-4b99-979f-29a9045b4108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:24.280876 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: INFO dbcounter [None req-b47e15ee-7244-4b99-979f-29a9045b4108 None None] Registered counter for database keystone Jun 18 04:04:24.305194 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG oslo_db.sqlalchemy.engines [None req-b47e15ee-7244-4b99-979f-29a9045b4108 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80241) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 18 04:04:24.316225 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writer thread running {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 18 04:04:24.505580 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG passlib.handlers.bcrypt [None req-b47e15ee-7244-4b99-979f-29a9045b4108 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80241) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 18 04:04:24.505990 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG passlib.handlers.bcrypt [None req-b47e15ee-7244-4b99-979f-29a9045b4108 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80241) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 18 04:04:24.561010 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-b47e15ee-7244-4b99-979f-29a9045b4108 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:04:24.562510 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b47e15ee-7244-4b99-979f-29a9045b4108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:04:24.688962 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 2/3] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:04:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 482 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 18 04:04:24.847828 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb941d9d-d254-4c08-9f01-28b0a88275dc None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:24.920927 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: INFO dbcounter [None req-bb941d9d-d254-4c08-9f01-28b0a88275dc None None] Registered counter for database keystone Jun 18 04:04:24.942513 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG oslo_db.sqlalchemy.engines [None req-bb941d9d-d254-4c08-9f01-28b0a88275dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80240) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 18 04:04:24.954654 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writer thread running {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 18 04:04:25.078331 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb941d9d-d254-4c08-9f01-28b0a88275dc None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:25.083776 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427455c8-7d27-487f-87dd-e4c54d1e7c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c8b5d4bdeea4b829107c59f65874f03', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:25.084455 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427455c8-7d27-487f-87dd-e4c54d1e7c33 admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:25.084772 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427455c8-7d27-487f-87dd-e4c54d1e7c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:25.085048 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427455c8-7d27-487f-87dd-e4c54d1e7c33 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:25.094311 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427455c8-7d27-487f-87dd-e4c54d1e7c33 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:25.146510 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: WARNING keystone.common.rbac_enforcer.enforcer [None req-427455c8-7d27-487f-87dd-e4c54d1e7c33 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 18 04:04:25.146772 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427455c8-7d27-487f-87dd-e4c54d1e7c33 admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:25.157348 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1324 bytes} [Sat Jun 18 04:04:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 04:04:25.163388 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47e15ee-7244-4b99-979f-29a9045b4108 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:25.178505 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47e15ee-7244-4b99-979f-29a9045b4108 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:25.184370 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca3e51-2624-41ad-9538-44488a8606ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c8b5d4bdeea4b829107c59f65874f03', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:25.185675 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca3e51-2624-41ad-9538-44488a8606ea admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:25.186054 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca3e51-2624-41ad-9538-44488a8606ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:25.186400 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca3e51-2624-41ad-9538-44488a8606ea admin admin] PATH_INFO: `/v3/projects/5c8b5d4bdeea4b829107c59f65874f03` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:25.190765 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ca3e51-2624-41ad-9538-44488a8606ea admin admin] RBAC: Authorizing `identity:get_project(project_id=5c8b5d4bdeea4b829107c59f65874f03)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:25.241728 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b5ca3e51-2624-41ad-9538-44488a8606ea admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 18 04:04:25.242298 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ca3e51-2624-41ad-9538-44488a8606ea admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:25.247371 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 3/5] 10.222.0.20 () {56 vars in 1207 bytes} [Sat Jun 18 04:04:25 2022] GET /identity/v3/projects/5c8b5d4bdeea4b829107c59f65874f03 => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:27.249766 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135c880-8ffa-4078-b1df-78309ee1986b None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:27.250303 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135c880-8ffa-4078-b1df-78309ee1986b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:27.250303 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135c880-8ffa-4078-b1df-78309ee1986b None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:27.254384 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 3/6] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:04:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:04:27.261065 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8bcd9-499a-4050-9589-b48fc6346642 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:27.261814 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8bcd9-499a-4050-9589-b48fc6346642 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:27.261960 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8bcd9-499a-4050-9589-b48fc6346642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:27.287100 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-3ca8bcd9-499a-4050-9589-b48fc6346642 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:04:27.288614 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-3ca8bcd9-499a-4050-9589-b48fc6346642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:04:27.298742 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:04:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 18 04:04:27.320902 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135c880-8ffa-4078-b1df-78309ee1986b None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:27.335131 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135c880-8ffa-4078-b1df-78309ee1986b None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:27.340380 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62204d84-e67c-4baa-8674-6e2b3509717a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c8b5d4bdeea4b829107c59f65874f03', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:27.341043 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62204d84-e67c-4baa-8674-6e2b3509717a admin admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:27.341322 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62204d84-e67c-4baa-8674-6e2b3509717a admin admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:27.341604 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62204d84-e67c-4baa-8674-6e2b3509717a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:27.349574 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62204d84-e67c-4baa-8674-6e2b3509717a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:27.351360 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62204d84-e67c-4baa-8674-6e2b3509717a admin admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:27.360698 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 4/8] 10.222.0.20 () {58 vars in 1324 bytes} [Sat Jun 18 04:04:27 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 04:04:27.366226 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca8bcd9-499a-4050-9589-b48fc6346642 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:27.375470 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca8bcd9-499a-4050-9589-b48fc6346642 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:27.381873 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5afe757-5d2e-4ad0-9fdc-e0cb6ceb36f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c8b5d4bdeea4b829107c59f65874f03', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:27.382744 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5afe757-5d2e-4ad0-9fdc-e0cb6ceb36f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:27.383022 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5afe757-5d2e-4ad0-9fdc-e0cb6ceb36f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:27.383298 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5afe757-5d2e-4ad0-9fdc-e0cb6ceb36f2 admin admin] PATH_INFO: `/v3/users/7064955bb91f4385a8d5f4c522c8d511` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:27.384959 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5afe757-5d2e-4ad0-9fdc-e0cb6ceb36f2 admin admin] RBAC: Authorizing `identity:get_user(user_id=7064955bb91f4385a8d5f4c522c8d511)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:27.386795 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5afe757-5d2e-4ad0-9fdc-e0cb6ceb36f2 admin admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:27.388394 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 5/9] 10.222.0.20 () {56 vars in 1198 bytes} [Sat Jun 18 04:04:27 2022] GET /identity/v3/users/7064955bb91f4385a8d5f4c522c8d511 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:29.420639 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f61044-1056-4419-b2f9-cf7606edeff1 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:29.421168 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f61044-1056-4419-b2f9-cf7606edeff1 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:29.421168 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f61044-1056-4419-b2f9-cf7606edeff1 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:29.422470 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 5/10] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:04:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:04:29.427735 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674dfd4-b850-4a16-8fbb-56f71e35e85f None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:29.428176 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674dfd4-b850-4a16-8fbb-56f71e35e85f None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:29.428264 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674dfd4-b850-4a16-8fbb-56f71e35e85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:29.446062 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-a674dfd4-b850-4a16-8fbb-56f71e35e85f None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:04:29.447236 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a674dfd4-b850-4a16-8fbb-56f71e35e85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:04:29.467154 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67415980-f7b5-455e-876c-3fd7b451e72d None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:29.467447 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67415980-f7b5-455e-876c-3fd7b451e72d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:29.467717 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67415980-f7b5-455e-876c-3fd7b451e72d None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:29.469231 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 6/11] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:04:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 18 04:04:29.474508 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728dbdc-9f93-4b57-9472-c1393643f344 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:29.474793 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728dbdc-9f93-4b57-9472-c1393643f344 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:29.475067 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728dbdc-9f93-4b57-9472-c1393643f344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:29.518670 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG passlib.handlers.bcrypt [None req-a728dbdc-9f93-4b57-9472-c1393643f344 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80240) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 18 04:04:29.519530 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG passlib.handlers.bcrypt [None req-a728dbdc-9f93-4b57-9472-c1393643f344 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80240) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 18 04:04:29.533048 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 6/12] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:04:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:04:29.556036 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674dfd4-b850-4a16-8fbb-56f71e35e85f None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:29.572105 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-a728dbdc-9f93-4b57-9472-c1393643f344 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:04:29.573774 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a728dbdc-9f93-4b57-9472-c1393643f344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:04:29.582083 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:29.664192 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674dfd4-b850-4a16-8fbb-56f71e35e85f None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:29.675365 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 7/13] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:04:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:04:29.697003 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2178c1c-7361-46a7-bdb5-fa8c8360964f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:29.697449 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a728dbdc-9f93-4b57-9472-c1393643f344 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:29.697811 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2178c1c-7361-46a7-bdb5-fa8c8360964f None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:29.698120 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2178c1c-7361-46a7-bdb5-fa8c8360964f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:29.698467 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2178c1c-7361-46a7-bdb5-fa8c8360964f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:29.709510 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2178c1c-7361-46a7-bdb5-fa8c8360964f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:04:29.720731 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-a2178c1c-7361-46a7-bdb5-fa8c8360964f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 04:04:29.720731 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:04:29.720731 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:04:29.720731 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:04:29.720731 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:04:29.720731 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:04:29.720731 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:04:29.720731 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:04:29.720731 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:04:29.720731 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:04:29.720731 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:04:29.720731 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:04:29.720731 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:04:29.720731 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:04:29.720731 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:04:29.720731 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:04:29.721718 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:04:29.721718 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:04:29.721718 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:04:29.721718 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:04:29.721718 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:04:29.721718 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:04:29.721718 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:04:29.721718 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:04:29.721718 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:04:29.721718 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:04:29.721718 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:04:29.721718 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:04:29.721718 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:04:29.721718 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:04:29.721718 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:04:29.721718 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:04:29.722510 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:04:29.722510 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:04:29.722510 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:04:29.722510 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:04:29.722510 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:04:29.722510 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:04:29.722510 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:04:29.722510 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:04:29.722510 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:04:29.722510 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:04:29.722510 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 04:04:29.722510 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:04:29.722510 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 7/14] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Jun 18 04:04:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:04:29.727965 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2178c1c-7361-46a7-bdb5-fa8c8360964f None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:29.803684 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a728dbdc-9f93-4b57-9472-c1393643f344 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:29.806239 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:29.809316 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:29.828164 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2178c1c-7361-46a7-bdb5-fa8c8360964f None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:29.842303 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7a9d8-fd50-4df6-b49a-497adc0863ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:29.843217 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7a9d8-fd50-4df6-b49a-497adc0863ae None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:29.843500 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7a9d8-fd50-4df6-b49a-497adc0863ae None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:29.843770 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7a9d8-fd50-4df6-b49a-497adc0863ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:29.863510 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870bc21b-6cd5-4875-8860-726e1c770d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:29.864181 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870bc21b-6cd5-4875-8860-726e1c770d0f None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:29.864464 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870bc21b-6cd5-4875-8860-726e1c770d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:29.864768 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870bc21b-6cd5-4875-8860-726e1c770d0f None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:29.865526 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870bc21b-6cd5-4875-8860-726e1c770d0f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:04:29.865853 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870bc21b-6cd5-4875-8860-726e1c770d0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:29.867251 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870bc21b-6cd5-4875-8860-726e1c770d0f None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:29.879130 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 8/15] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Jun 18 04:04:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:29.884792 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870bc21b-6cd5-4875-8860-726e1c770d0f None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:29.914831 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f7a9d8-fd50-4df6-b49a-497adc0863ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:29.916364 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f7a9d8-fd50-4df6-b49a-497adc0863ae None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:29.995094 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870bc21b-6cd5-4875-8860-726e1c770d0f None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:30.021345 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 8/16] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Jun 18 04:04:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 18 04:04:30.027103 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7a9d8-fd50-4df6-b49a-497adc0863ae None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:30.028532 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71c2f8-7791-480a-9e3c-c7c795f39f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:30.029451 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71c2f8-7791-480a-9e3c-c7c795f39f17 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:30.029740 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71c2f8-7791-480a-9e3c-c7c795f39f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:30.029863 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:30.030015 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71c2f8-7791-480a-9e3c-c7c795f39f17 None admin] PATH_INFO: `/v3/users/7064955bb91f4385a8d5f4c522c8d511` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:30.031562 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a71c2f8-7791-480a-9e3c-c7c795f39f17 None admin] RBAC: Authorizing `identity:get_user(user_id=7064955bb91f4385a8d5f4c522c8d511)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:30.033070 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a71c2f8-7791-480a-9e3c-c7c795f39f17 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:30.034693 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 9/17] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Jun 18 04:04:29 2022] GET /identity/v3/users/7064955bb91f4385a8d5f4c522c8d511 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:04:30.039895 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71c2f8-7791-480a-9e3c-c7c795f39f17 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:30.055050 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:30.128594 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7a9d8-fd50-4df6-b49a-497adc0863ae None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:30.141209 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71c2f8-7791-480a-9e3c-c7c795f39f17 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:30.164587 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a83aff-dff5-483b-a9d6-8aed9d417d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:30.165734 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a83aff-dff5-483b-a9d6-8aed9d417d0b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:30.166008 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a83aff-dff5-483b-a9d6-8aed9d417d0b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:30.166279 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a83aff-dff5-483b-a9d6-8aed9d417d0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:30.175734 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740fb888-42ba-4a70-bf73-b05f55eeeb65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:30.176522 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fb888-42ba-4a70-bf73-b05f55eeeb65 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:30.176832 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fb888-42ba-4a70-bf73-b05f55eeeb65 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:30.177103 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fb888-42ba-4a70-bf73-b05f55eeeb65 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:30.178287 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740fb888-42ba-4a70-bf73-b05f55eeeb65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:30.179748 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740fb888-42ba-4a70-bf73-b05f55eeeb65 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:30.181899 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 10/18] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:04:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:30.186389 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a83aff-dff5-483b-a9d6-8aed9d417d0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:30.187647 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740fb888-42ba-4a70-bf73-b05f55eeeb65 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:30.187865 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a83aff-dff5-483b-a9d6-8aed9d417d0b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:30.208840 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-97a83aff-dff5-483b-a9d6-8aed9d417d0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:04:30.208840 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:04:30.208840 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:04:30.208840 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:04:30.208840 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:04:30.208840 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:04:30.208840 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:04:30.208840 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:04:30.208840 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:04:30.208840 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:04:30.208840 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:04:30.208840 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:04:30.208840 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:04:30.208840 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:04:30.208840 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:04:30.209675 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:04:30.209675 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:04:30.209675 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:04:30.209675 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:04:30.209675 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:04:30.209675 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:04:30.209675 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:04:30.209675 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:04:30.209675 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:04:30.209675 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:04:30.209675 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:04:30.209675 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:04:30.209675 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:04:30.209675 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:04:30.209675 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:04:30.209675 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:04:30.209675 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:04:30.210447 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:04:30.210447 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:04:30.210447 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:04:30.210447 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:04:30.210447 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 9/19] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:04:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 04:04:30.216301 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a83aff-dff5-483b-a9d6-8aed9d417d0b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:30.278553 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:30.285022 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:30.304930 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740fb888-42ba-4a70-bf73-b05f55eeeb65 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:30.324103 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a83aff-dff5-483b-a9d6-8aed9d417d0b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:30.338459 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3ec39-8c55-45de-be6c-9acd1e6cfcbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:30.339157 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3ec39-8c55-45de-be6c-9acd1e6cfcbb None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:30.339440 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3ec39-8c55-45de-be6c-9acd1e6cfcbb None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:30.339718 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3ec39-8c55-45de-be6c-9acd1e6cfcbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:30.340560 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a3ec39-8c55-45de-be6c-9acd1e6cfcbb None admin] RBAC: Adding query filter params (role.id=d783a633c75847d48ef7ef5b169b0313, scope.domain.id=default, user.id=7064955bb91f4385a8d5f4c522c8d511) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:04:30.341125 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a3ec39-8c55-45de-be6c-9acd1e6cfcbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:30.342610 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a3ec39-8c55-45de-be6c-9acd1e6cfcbb None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:30.349499 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 11/20] 10.222.0.20 () {56 vars in 1322 bytes} [Sat Jun 18 04:04:30 2022] GET /identity/v3/role_assignments?user.id=7064955bb91f4385a8d5f4c522c8d511&scope.domain.id=default&role.id=d783a633c75847d48ef7ef5b169b0313 => generated 233 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:04:30.357740 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08420b87-2512-48ad-ba0c-a66db1d4f892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:30.358436 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08420b87-2512-48ad-ba0c-a66db1d4f892 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:30.358720 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08420b87-2512-48ad-ba0c-a66db1d4f892 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:30.359001 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08420b87-2512-48ad-ba0c-a66db1d4f892 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:30.360113 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08420b87-2512-48ad-ba0c-a66db1d4f892 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:04:30.360424 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08420b87-2512-48ad-ba0c-a66db1d4f892 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:30.361900 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08420b87-2512-48ad-ba0c-a66db1d4f892 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:30.382086 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 10/21] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:04:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:04:32.648650 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec88a8-d1fb-48fa-9fd8-650256aed6f3 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:32.649662 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec88a8-d1fb-48fa-9fd8-650256aed6f3 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:32.650143 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec88a8-d1fb-48fa-9fd8-650256aed6f3 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:32.651817 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 12/22] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:04:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:04:32.657501 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a84bd-7b71-4069-a017-baba22833fd3 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:32.658309 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a84bd-7b71-4069-a017-baba22833fd3 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:32.658769 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a84bd-7b71-4069-a017-baba22833fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:32.676823 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-503a84bd-7b71-4069-a017-baba22833fd3 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:04:32.678345 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-503a84bd-7b71-4069-a017-baba22833fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:04:32.749433 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 11/23] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:04:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:04:32.798431 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ec88a8-d1fb-48fa-9fd8-650256aed6f3 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:32.810267 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226413ff-ebc0-4199-bb2f-465249538952 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:32.811067 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226413ff-ebc0-4199-bb2f-465249538952 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:32.811558 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226413ff-ebc0-4199-bb2f-465249538952 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:32.815499 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 12/24] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:04:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:04:32.821443 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806361e0-bf7a-453d-834d-9532ccec3deb None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:32.822065 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806361e0-bf7a-453d-834d-9532ccec3deb None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:32.822529 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806361e0-bf7a-453d-834d-9532ccec3deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:32.848738 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-806361e0-bf7a-453d-834d-9532ccec3deb None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:04:32.850329 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-806361e0-bf7a-453d-834d-9532ccec3deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:04:32.910687 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:32.956765 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 13/25] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:04:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 18 04:04:33.011955 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806361e0-bf7a-453d-834d-9532ccec3deb None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:33.030308 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ec88a8-d1fb-48fa-9fd8-650256aed6f3 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:33.087080 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979cbb0d-2d33-4837-8428-f3777cbf1fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:33.087892 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979cbb0d-2d33-4837-8428-f3777cbf1fce None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:33.088174 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979cbb0d-2d33-4837-8428-f3777cbf1fce None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:33.088456 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979cbb0d-2d33-4837-8428-f3777cbf1fce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:33.109172 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979cbb0d-2d33-4837-8428-f3777cbf1fce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:04:33.121400 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-979cbb0d-2d33-4837-8428-f3777cbf1fce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 04:04:33.121400 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:04:33.121400 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:04:33.121400 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:04:33.121400 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:04:33.121400 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:04:33.121400 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:04:33.121400 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:04:33.121400 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:04:33.121400 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:04:33.121400 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:04:33.121400 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:04:33.121400 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:04:33.121400 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:04:33.121400 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:04:33.121400 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:04:33.122276 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:04:33.122276 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:04:33.122276 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:04:33.122276 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:04:33.122276 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:04:33.122276 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:04:33.122276 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:04:33.122276 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:04:33.122276 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:04:33.122276 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:04:33.122276 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:04:33.122276 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:04:33.122276 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:04:33.122276 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:04:33.122276 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:04:33.122276 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:04:33.123009 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:04:33.123009 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:04:33.123009 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:04:33.123009 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:04:33.123009 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:04:33.123009 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:04:33.123009 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:04:33.123009 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:04:33.123009 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:04:33.123009 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:04:33.123009 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 04:04:33.123009 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:04:33.123558 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 13/26] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Jun 18 04:04:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:04:33.129222 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979cbb0d-2d33-4837-8428-f3777cbf1fce None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:33.143152 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:33.258902 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806361e0-bf7a-453d-834d-9532ccec3deb None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:33.294840 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a56aad-40f2-4f1a-a23f-bd27b4d1bbdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:33.295887 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a56aad-40f2-4f1a-a23f-bd27b4d1bbdc None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:33.296331 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a56aad-40f2-4f1a-a23f-bd27b4d1bbdc None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:33.296765 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a56aad-40f2-4f1a-a23f-bd27b4d1bbdc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:33.309369 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a56aad-40f2-4f1a-a23f-bd27b4d1bbdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:33.311056 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a56aad-40f2-4f1a-a23f-bd27b4d1bbdc None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:33.340934 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-55a56aad-40f2-4f1a-a23f-bd27b4d1bbdc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:04:33.340934 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:04:33.340934 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:04:33.340934 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:04:33.340934 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:04:33.340934 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:04:33.340934 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:04:33.340934 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:04:33.340934 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:04:33.340934 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:04:33.340934 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:04:33.340934 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:04:33.340934 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:04:33.340934 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:04:33.340934 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:04:33.341995 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:04:33.341995 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:04:33.341995 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:04:33.341995 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:04:33.341995 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:04:33.341995 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:04:33.341995 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:04:33.341995 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:04:33.341995 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:04:33.341995 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:04:33.341995 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:04:33.341995 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:04:33.341995 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:04:33.341995 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:04:33.341995 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:04:33.341995 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:04:33.341995 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:04:33.343028 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:04:33.343028 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:04:33.343028 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:04:33.343028 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:04:33.346099 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979cbb0d-2d33-4837-8428-f3777cbf1fce None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:33.349005 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 14/27] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:04:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 04:04:33.356534 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d43f2-1326-4efd-a1ab-9fc039993287 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:33.357146 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d43f2-1326-4efd-a1ab-9fc039993287 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:33.357551 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d43f2-1326-4efd-a1ab-9fc039993287 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:33.361798 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 15/28] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:04:33 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:04:33.362846 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d43f2-1326-4efd-a1ab-9fc039993287 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:33.414147 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7f68f-1519-4cb9-b366-b2421ebd9b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:33.415134 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7f68f-1519-4cb9-b366-b2421ebd9b8f None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:33.415780 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7f68f-1519-4cb9-b366-b2421ebd9b8f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:33.417041 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7f68f-1519-4cb9-b366-b2421ebd9b8f None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:33.418595 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c7f68f-1519-4cb9-b366-b2421ebd9b8f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:04:33.419212 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c7f68f-1519-4cb9-b366-b2421ebd9b8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:33.422097 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c7f68f-1519-4cb9-b366-b2421ebd9b8f None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:33.423169 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:33.432724 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 14/29] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Jun 18 04:04:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:33.434622 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37f8c6-e2b0-40a2-8bec-7193e3796fcd None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:33.434622 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37f8c6-e2b0-40a2-8bec-7193e3796fcd None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:33.434809 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37f8c6-e2b0-40a2-8bec-7193e3796fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:33.453115 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-8a37f8c6-e2b0-40a2-8bec-7193e3796fcd None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:04:33.454341 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-8a37f8c6-e2b0-40a2-8bec-7193e3796fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:04:33.507206 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d43f2-1326-4efd-a1ab-9fc039993287 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:33.516843 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:33.532730 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 15/30] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:04:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:04:33.532730 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819d6be-c084-4415-98c2-e74d6c786894 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:33.532730 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819d6be-c084-4415-98c2-e74d6c786894 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:33.532730 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819d6be-c084-4415-98c2-e74d6c786894 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:33.532730 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 16/31] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:04:33.532730 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819d6be-c084-4415-98c2-e74d6c786894 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:33.564160 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1445d1ba-66a6-4e78-9ee0-c312c0c746af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:33.565267 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445d1ba-66a6-4e78-9ee0-c312c0c746af None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:33.565772 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445d1ba-66a6-4e78-9ee0-c312c0c746af None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:33.566237 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445d1ba-66a6-4e78-9ee0-c312c0c746af None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:33.567199 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1445d1ba-66a6-4e78-9ee0-c312c0c746af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:04:33.567781 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1445d1ba-66a6-4e78-9ee0-c312c0c746af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:33.569466 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1445d1ba-66a6-4e78-9ee0-c312c0c746af None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:33.584009 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 16/32] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:04:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:33.585637 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128460b-9de7-449b-906f-6631fc2315ff None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:33.586118 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128460b-9de7-449b-906f-6631fc2315ff None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:33.586651 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128460b-9de7-449b-906f-6631fc2315ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:33.603735 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-b128460b-9de7-449b-906f-6631fc2315ff None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:04:33.605574 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b128460b-9de7-449b-906f-6631fc2315ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:04:33.662819 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819d6be-c084-4415-98c2-e74d6c786894 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:33.678711 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 17/33] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:04:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:04:33.680197 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b128460b-9de7-449b-906f-6631fc2315ff None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:33.713665 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:33.724265 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6151d56-48c9-4334-bbe7-5b8e01f44a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:33.726110 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6151d56-48c9-4334-bbe7-5b8e01f44a37 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:33.726646 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6151d56-48c9-4334-bbe7-5b8e01f44a37 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:33.727350 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6151d56-48c9-4334-bbe7-5b8e01f44a37 None admin] PATH_INFO: `/v3/users/7064955bb91f4385a8d5f4c522c8d511` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:33.729603 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6151d56-48c9-4334-bbe7-5b8e01f44a37 None admin] RBAC: Authorizing `identity:get_user(user_id=7064955bb91f4385a8d5f4c522c8d511)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:33.731667 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6151d56-48c9-4334-bbe7-5b8e01f44a37 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:33.734895 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 17/34] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Jun 18 04:04:33 2022] GET /identity/v3/users/7064955bb91f4385a8d5f4c522c8d511 => generated 247 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:33.735902 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6151d56-48c9-4334-bbe7-5b8e01f44a37 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:33.814095 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b128460b-9de7-449b-906f-6631fc2315ff None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:33.821430 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:33.859742 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843ec012-f157-4e95-96f2-5e8cea11aad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:33.862654 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ec012-f157-4e95-96f2-5e8cea11aad6 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:33.863816 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ec012-f157-4e95-96f2-5e8cea11aad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:33.864468 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ec012-f157-4e95-96f2-5e8cea11aad6 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:33.866405 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843ec012-f157-4e95-96f2-5e8cea11aad6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:33.867928 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843ec012-f157-4e95-96f2-5e8cea11aad6 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:33.875236 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6151d56-48c9-4334-bbe7-5b8e01f44a37 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:33.910959 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c2bae-d5ef-4a19-86cb-4d921cc9c658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:33.911732 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c2bae-d5ef-4a19-86cb-4d921cc9c658 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:33.912079 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c2bae-d5ef-4a19-86cb-4d921cc9c658 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:33.912420 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c2bae-d5ef-4a19-86cb-4d921cc9c658 None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:33.913260 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c2bae-d5ef-4a19-86cb-4d921cc9c658 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:33.914777 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c2bae-d5ef-4a19-86cb-4d921cc9c658 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:34.004615 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 18/35] 10.222.0.20 () {60 vars in 1131 bytes} [Sat Jun 18 04:04:33 2022] POST /identity/v3/roles => generated 219 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 04:04:34.004615 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843ec012-f157-4e95-96f2-5e8cea11aad6 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:34.046451 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 18/36] 10.222.0.20 () {60 vars in 1141 bytes} [Sat Jun 18 04:04:33 2022] POST /identity/v3/projects => generated 301 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 04:04:34.047342 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c2bae-d5ef-4a19-86cb-4d921cc9c658 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:34.106952 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:34.146911 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843ec012-f157-4e95-96f2-5e8cea11aad6 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:34.223368 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971d653-8dbc-41e5-b134-dcb35e6af3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:34.225090 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971d653-8dbc-41e5-b134-dcb35e6af3a7 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:34.225623 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971d653-8dbc-41e5-b134-dcb35e6af3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:34.226146 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971d653-8dbc-41e5-b134-dcb35e6af3a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:34.227149 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c971d653-8dbc-41e5-b134-dcb35e6af3a7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:34.229121 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c971d653-8dbc-41e5-b134-dcb35e6af3a7 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:34.246458 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c2bae-d5ef-4a19-86cb-4d921cc9c658 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:34.249735 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 19/37] 10.222.0.20 () {60 vars in 1131 bytes} [Sat Jun 18 04:04:33 2022] POST /identity/v3/roles => generated 225 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 04:04:34.251602 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e87c6-4689-4508-a32e-68eafedd6ef3 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:34.252133 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e87c6-4689-4508-a32e-68eafedd6ef3 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:34.252639 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e87c6-4689-4508-a32e-68eafedd6ef3 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:34.259682 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 20/38] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:04:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:04:34.262129 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f88ec-8875-4a8e-8bd9-4d8a1f9dfef5 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:34.262417 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f88ec-8875-4a8e-8bd9-4d8a1f9dfef5 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:34.262696 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f88ec-8875-4a8e-8bd9-4d8a1f9dfef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:34.270787 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:34.297684 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-502f88ec-8875-4a8e-8bd9-4d8a1f9dfef5 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:04:34.300044 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-502f88ec-8875-4a8e-8bd9-4d8a1f9dfef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:04:34.300418 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e5618c-fb46-4bbd-8cf5-f7f418e9f932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:34.301304 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5618c-fb46-4bbd-8cf5-f7f418e9f932 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:34.301589 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5618c-fb46-4bbd-8cf5-f7f418e9f932 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:34.301870 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5618c-fb46-4bbd-8cf5-f7f418e9f932 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:34.303202 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e5618c-fb46-4bbd-8cf5-f7f418e9f932 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:34.305159 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e5618c-fb46-4bbd-8cf5-f7f418e9f932 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:34.308002 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 19/39] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:04:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:34.314509 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e5618c-fb46-4bbd-8cf5-f7f418e9f932 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:34.401943 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 21/40] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:04:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:04:34.405336 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f892b-9667-46c1-a9d9-fb358015394b None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:34.406236 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f892b-9667-46c1-a9d9-fb358015394b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:34.406687 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f892b-9667-46c1-a9d9-fb358015394b None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:34.409718 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 22/41] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:04:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:04:34.421365 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f6f8b-b9bb-47ae-8f35-60b54b73114e None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:34.421556 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f6f8b-b9bb-47ae-8f35-60b54b73114e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:34.421758 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f6f8b-b9bb-47ae-8f35-60b54b73114e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:34.443555 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-ee9f6f8b-b9bb-47ae-8f35-60b54b73114e None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:04:34.445546 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ee9f6f8b-b9bb-47ae-8f35-60b54b73114e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:04:34.446848 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e5618c-fb46-4bbd-8cf5-f7f418e9f932 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:34.491373 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9651cf-daf2-4230-af5e-b4f40ff721e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:34.492253 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9651cf-daf2-4230-af5e-b4f40ff721e8 None admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:34.492534 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9651cf-daf2-4230-af5e-b4f40ff721e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:34.492847 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9651cf-daf2-4230-af5e-b4f40ff721e8 None admin] PATH_INFO: `/v3/domains/default/users/7064955bb91f4385a8d5f4c522c8d511/roles/d783a633c75847d48ef7ef5b169b0313` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:34.495094 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9651cf-daf2-4230-af5e-b4f40ff721e8 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=7064955bb91f4385a8d5f4c522c8d511, role_id=d783a633c75847d48ef7ef5b169b0313)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:34.496553 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9651cf-daf2-4230-af5e-b4f40ff721e8 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:34.511694 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 20/42] 10.222.0.20 () {58 vars in 1361 bytes} [Sat Jun 18 04:04:34 2022] PUT /identity/v3/domains/default/users/7064955bb91f4385a8d5f4c522c8d511/roles/d783a633c75847d48ef7ef5b169b0313 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 04:04:34.512480 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9651cf-daf2-4230-af5e-b4f40ff721e8 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:34.517806 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:34.524952 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 23/43] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:04:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:04:34.552682 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f6f8b-b9bb-47ae-8f35-60b54b73114e None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:34.568915 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:34.633666 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9651cf-daf2-4230-af5e-b4f40ff721e8 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:34.673078 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25934d0-5d11-44ee-8e67-3f767b594ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:34.673852 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25934d0-5d11-44ee-8e67-3f767b594ea8 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:34.674229 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25934d0-5d11-44ee-8e67-3f767b594ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:34.674610 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25934d0-5d11-44ee-8e67-3f767b594ea8 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:34.675477 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25934d0-5d11-44ee-8e67-3f767b594ea8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:34.675978 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f6f8b-b9bb-47ae-8f35-60b54b73114e None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:34.677107 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25934d0-5d11-44ee-8e67-3f767b594ea8 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:34.692922 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 21/44] 10.222.0.20 () {60 vars in 1131 bytes} [Sat Jun 18 04:04:34 2022] POST /identity/v3/roles => generated 223 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 04:04:34.723535 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b013b-5e85-47a6-9a41-39730513f7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:34.724366 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b013b-5e85-47a6-9a41-39730513f7a8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:34.724681 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b013b-5e85-47a6-9a41-39730513f7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:34.724959 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b013b-5e85-47a6-9a41-39730513f7a8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:34.726527 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b013b-5e85-47a6-9a41-39730513f7a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:34.728029 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b013b-5e85-47a6-9a41-39730513f7a8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:34.730108 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 24/45] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:04:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:04:34.735968 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25934d0-5d11-44ee-8e67-3f767b594ea8 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:34.957959 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25934d0-5d11-44ee-8e67-3f767b594ea8 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:34.961428 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:34.998654 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1d3cd-22d6-4ff4-a970-bc6454398826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:34.999311 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1d3cd-22d6-4ff4-a970-bc6454398826 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:34.999594 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1d3cd-22d6-4ff4-a970-bc6454398826 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:34.999869 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1d3cd-22d6-4ff4-a970-bc6454398826 None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:35.000608 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b1d3cd-22d6-4ff4-a970-bc6454398826 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:35.002082 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b1d3cd-22d6-4ff4-a970-bc6454398826 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:35.027940 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 22/46] 10.222.0.20 () {60 vars in 1141 bytes} [Sat Jun 18 04:04:34 2022] POST /identity/v3/projects => generated 312 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 04:04:36.507886 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88359339-44d8-45a3-9c07-35cab7e4334f None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:36.508408 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88359339-44d8-45a3-9c07-35cab7e4334f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:36.508408 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88359339-44d8-45a3-9c07-35cab7e4334f None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:36.510149 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 25/47] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:04:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:04:36.515418 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24158338-6cb5-4880-b2c4-f682d63f36f1 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:36.515796 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24158338-6cb5-4880-b2c4-f682d63f36f1 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:36.516045 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24158338-6cb5-4880-b2c4-f682d63f36f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:36.534074 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-24158338-6cb5-4880-b2c4-f682d63f36f1 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:04:36.535606 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-24158338-6cb5-4880-b2c4-f682d63f36f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:04:36.605904 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 23/48] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:04:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:04:36.632917 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88359339-44d8-45a3-9c07-35cab7e4334f None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:36.702747 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:36.742518 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88359339-44d8-45a3-9c07-35cab7e4334f None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:36.777905 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179977df-4194-4d77-9655-ac75f44f71c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:36.778624 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179977df-4194-4d77-9655-ac75f44f71c6 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:36.778903 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179977df-4194-4d77-9655-ac75f44f71c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:36.779174 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179977df-4194-4d77-9655-ac75f44f71c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:36.791295 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179977df-4194-4d77-9655-ac75f44f71c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:04:36.800129 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-179977df-4194-4d77-9655-ac75f44f71c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 04:04:36.800129 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:04:36.800129 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:04:36.800129 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:04:36.800129 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:04:36.800129 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:04:36.800129 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:04:36.800129 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:04:36.800129 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:04:36.800129 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:04:36.800129 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:04:36.800129 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:04:36.800129 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:04:36.800129 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:04:36.800129 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:04:36.800129 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:04:36.801045 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:04:36.801045 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:04:36.801045 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:04:36.801045 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:04:36.801045 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:04:36.801045 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:04:36.801045 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:04:36.801045 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:04:36.801045 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:04:36.801045 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:04:36.801045 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:04:36.801045 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:04:36.801045 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:04:36.801045 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:04:36.801045 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:04:36.801045 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:04:36.801846 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:04:36.801846 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:04:36.801846 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:04:36.801846 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:04:36.801846 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:04:36.801846 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:04:36.801846 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:04:36.801846 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:04:36.801846 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:04:36.801846 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:04:36.801846 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 04:04:36.801846 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:04:36.801846 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 26/49] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Jun 18 04:04:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:04:36.808634 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24158338-6cb5-4880-b2c4-f682d63f36f1 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:36.898219 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:36.914364 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24158338-6cb5-4880-b2c4-f682d63f36f1 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:36.949757 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3997e426-59dc-4805-a137-09d3bef3391e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:36.950430 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997e426-59dc-4805-a137-09d3bef3391e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:36.950711 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997e426-59dc-4805-a137-09d3bef3391e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:36.950982 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997e426-59dc-4805-a137-09d3bef3391e None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:36.951739 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3997e426-59dc-4805-a137-09d3bef3391e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:04:36.952047 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3997e426-59dc-4805-a137-09d3bef3391e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:36.953480 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3997e426-59dc-4805-a137-09d3bef3391e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:36.962298 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 24/50] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Jun 18 04:04:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:36.967843 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179977df-4194-4d77-9655-ac75f44f71c6 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:37.023634 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f30288-3644-40dc-8466-1de47e81fd92 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:37.023893 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f30288-3644-40dc-8466-1de47e81fd92 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:37.024168 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f30288-3644-40dc-8466-1de47e81fd92 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:37.025598 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 25/51] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:04:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 18 04:04:37.030802 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4c4fc-6be2-4680-81ba-4e4968fc7333 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:37.031033 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4c4fc-6be2-4680-81ba-4e4968fc7333 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:37.031309 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4c4fc-6be2-4680-81ba-4e4968fc7333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:37.048499 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-27e4c4fc-6be2-4680-81ba-4e4968fc7333 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:04:37.049778 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-27e4c4fc-6be2-4680-81ba-4e4968fc7333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:04:37.073520 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179977df-4194-4d77-9655-ac75f44f71c6 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:37.099198 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:37.109869 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122108ea-f7f0-4c9b-9604-dee2f0468ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:37.110755 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122108ea-f7f0-4c9b-9604-dee2f0468ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:37.111035 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122108ea-f7f0-4c9b-9604-dee2f0468ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:37.111300 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122108ea-f7f0-4c9b-9604-dee2f0468ff6 None admin] PATH_INFO: `/v3/users/7064955bb91f4385a8d5f4c522c8d511` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:37.112781 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122108ea-f7f0-4c9b-9604-dee2f0468ff6 None admin] RBAC: Authorizing `identity:get_user(user_id=7064955bb91f4385a8d5f4c522c8d511)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:37.114265 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122108ea-f7f0-4c9b-9604-dee2f0468ff6 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:37.115899 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 27/52] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Jun 18 04:04:36 2022] GET /identity/v3/users/7064955bb91f4385a8d5f4c522c8d511 => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:37.119947 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 26/53] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:04:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:04:37.121363 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122108ea-f7f0-4c9b-9604-dee2f0468ff6 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:37.142894 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e4c4fc-6be2-4680-81ba-4e4968fc7333 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:37.220627 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122108ea-f7f0-4c9b-9604-dee2f0468ff6 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:37.223913 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:37.246169 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e4c4fc-6be2-4680-81ba-4e4968fc7333 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:37.254312 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8257bd67-fe6f-4491-a2fa-b03dd77a3d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:37.255115 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8257bd67-fe6f-4491-a2fa-b03dd77a3d31 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:37.255398 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8257bd67-fe6f-4491-a2fa-b03dd77a3d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:37.255674 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8257bd67-fe6f-4491-a2fa-b03dd77a3d31 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:37.256894 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8257bd67-fe6f-4491-a2fa-b03dd77a3d31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:37.258364 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8257bd67-fe6f-4491-a2fa-b03dd77a3d31 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:37.259993 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 28/54] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:04:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:04:37.265631 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8257bd67-fe6f-4491-a2fa-b03dd77a3d31 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:37.280100 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb551a-6049-44e5-8eeb-f6c3470e067b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:37.281486 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb551a-6049-44e5-8eeb-f6c3470e067b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:37.281721 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb551a-6049-44e5-8eeb-f6c3470e067b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:37.282094 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb551a-6049-44e5-8eeb-f6c3470e067b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:37.284142 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbb551a-6049-44e5-8eeb-f6c3470e067b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:37.285791 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbb551a-6049-44e5-8eeb-f6c3470e067b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:37.288253 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 27/55] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:04:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:37.294584 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb551a-6049-44e5-8eeb-f6c3470e067b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:37.402460 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb551a-6049-44e5-8eeb-f6c3470e067b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:37.435840 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325f8620-872f-4511-a3d4-1175ea952cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:37.436514 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f8620-872f-4511-a3d4-1175ea952cae None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:37.436826 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f8620-872f-4511-a3d4-1175ea952cae None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:37.437123 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f8620-872f-4511-a3d4-1175ea952cae None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:37.437255 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:37.437816 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325f8620-872f-4511-a3d4-1175ea952cae None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:37.439280 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325f8620-872f-4511-a3d4-1175ea952cae None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:37.460178 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:37.467241 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 28/56] 10.222.0.20 () {60 vars in 1140 bytes} [Sat Jun 18 04:04:37 2022] POST /identity/v3/projects => generated 298 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 04:04:37.477374 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8257bd67-fe6f-4491-a2fa-b03dd77a3d31 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:37.517028 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25603061-431c-401a-b9e9-388665af6d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:37.517705 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25603061-431c-401a-b9e9-388665af6d41 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:37.517943 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25603061-431c-401a-b9e9-388665af6d41 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:37.518253 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25603061-431c-401a-b9e9-388665af6d41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:37.519122 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25603061-431c-401a-b9e9-388665af6d41 None admin] RBAC: Adding query filter params (role.id=d783a633c75847d48ef7ef5b169b0313, scope.domain.id=default, user.id=7064955bb91f4385a8d5f4c522c8d511) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:04:37.519435 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25603061-431c-401a-b9e9-388665af6d41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:37.520982 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25603061-431c-401a-b9e9-388665af6d41 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:37.531197 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 29/57] 10.222.0.20 () {56 vars in 1322 bytes} [Sat Jun 18 04:04:37 2022] GET /identity/v3/role_assignments?user.id=7064955bb91f4385a8d5f4c522c8d511&scope.domain.id=default&role.id=d783a633c75847d48ef7ef5b169b0313 => generated 530 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:04:39.477307 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3fb6f-ede5-4bbc-8a60-b6234712e2ad None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:39.478120 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3fb6f-ede5-4bbc-8a60-b6234712e2ad None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:39.478238 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3fb6f-ede5-4bbc-8a60-b6234712e2ad None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:39.480417 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 29/58] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:04:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:04:39.487034 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fe985-fe65-46d8-a699-21fb03da7cbb None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:39.487467 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fe985-fe65-46d8-a699-21fb03da7cbb None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:39.487633 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fe985-fe65-46d8-a699-21fb03da7cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:39.508458 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-618fe985-fe65-46d8-a699-21fb03da7cbb None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:04:39.509704 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-618fe985-fe65-46d8-a699-21fb03da7cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:04:39.578889 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 30/59] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:04:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:04:39.604890 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f3fb6f-ede5-4bbc-8a60-b6234712e2ad None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:39.725914 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f3fb6f-ede5-4bbc-8a60-b6234712e2ad None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:39.769578 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717ed84f-3fee-44f8-82c4-ea72aea88697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:39.770611 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ed84f-3fee-44f8-82c4-ea72aea88697 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:39.770894 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ed84f-3fee-44f8-82c4-ea72aea88697 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:39.771189 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ed84f-3fee-44f8-82c4-ea72aea88697 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:39.773052 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717ed84f-3fee-44f8-82c4-ea72aea88697 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:39.774595 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717ed84f-3fee-44f8-82c4-ea72aea88697 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:39.776252 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 30/60] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:04:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:39.782117 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618fe985-fe65-46d8-a699-21fb03da7cbb None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:39.844853 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:39.893800 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618fe985-fe65-46d8-a699-21fb03da7cbb None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:39.929097 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0525d35-1bb1-425d-b28e-94cba18ada7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:39.929777 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0525d35-1bb1-425d-b28e-94cba18ada7f None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:39.930148 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0525d35-1bb1-425d-b28e-94cba18ada7f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:39.930483 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0525d35-1bb1-425d-b28e-94cba18ada7f None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:39.931530 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0525d35-1bb1-425d-b28e-94cba18ada7f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:39.933976 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0525d35-1bb1-425d-b28e-94cba18ada7f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:39.962980 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 31/61] 10.222.0.20 () {60 vars in 1132 bytes} [Sat Jun 18 04:04:39 2022] POST /identity/v3/users => generated 275 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 04:04:43.082078 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb919e-00a5-4fd5-becb-b1b2cb4840d6 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:43.083116 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb919e-00a5-4fd5-becb-b1b2cb4840d6 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:43.083601 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb919e-00a5-4fd5-becb-b1b2cb4840d6 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:43.085296 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 31/62] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:04:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:04:43.098960 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f712d-4103-4255-ba9f-39f098304ec2 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:43.099418 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f712d-4103-4255-ba9f-39f098304ec2 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:43.099514 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f712d-4103-4255-ba9f-39f098304ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:43.125702 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-946f712d-4103-4255-ba9f-39f098304ec2 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:04:43.127274 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-946f712d-4103-4255-ba9f-39f098304ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:04:43.214941 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39abf5f4-60cb-4937-b56a-150a4dcebc5d None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:43.215606 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39abf5f4-60cb-4937-b56a-150a4dcebc5d None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:43.216197 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39abf5f4-60cb-4937-b56a-150a4dcebc5d None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:43.218136 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 32/63] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:04:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 18 04:04:43.223893 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c847ed2-65bd-477f-b3e3-dcc6bbd14fdb None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:43.224410 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c847ed2-65bd-477f-b3e3-dcc6bbd14fdb None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:43.224903 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c847ed2-65bd-477f-b3e3-dcc6bbd14fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:43.228692 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 32/64] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:04:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:04:43.253572 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-5c847ed2-65bd-477f-b3e3-dcc6bbd14fdb None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:04:43.255119 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5c847ed2-65bd-477f-b3e3-dcc6bbd14fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:04:43.291682 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f712d-4103-4255-ba9f-39f098304ec2 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:43.361989 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:43.362305 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:43.382261 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 33/65] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:04:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:04:43.419206 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c847ed2-65bd-477f-b3e3-dcc6bbd14fdb None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:43.449916 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f712d-4103-4255-ba9f-39f098304ec2 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:43.486702 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c2e35b-60ff-4912-b40e-f03c32842485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:43.486882 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2e35b-60ff-4912-b40e-f03c32842485 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:43.487133 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2e35b-60ff-4912-b40e-f03c32842485 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:43.487293 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2e35b-60ff-4912-b40e-f03c32842485 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:43.498838 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c2e35b-60ff-4912-b40e-f03c32842485 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:04:43.507060 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-47c2e35b-60ff-4912-b40e-f03c32842485 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 18 04:04:43.507060 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:04:43.507060 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:04:43.507060 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:04:43.507060 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:04:43.507060 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:04:43.507060 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:04:43.507060 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:04:43.507060 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:04:43.507060 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:04:43.507060 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:04:43.507060 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:04:43.507060 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:04:43.507060 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:04:43.507060 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:04:43.507060 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:04:43.507909 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:04:43.507909 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:04:43.507909 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:04:43.507909 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:04:43.507909 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:04:43.507909 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:04:43.507909 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:04:43.507909 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:04:43.507909 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:04:43.507909 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:04:43.507909 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:04:43.507909 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:04:43.507909 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:04:43.507909 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:04:43.507909 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:04:43.507909 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:04:43.508777 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:04:43.508777 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:04:43.508777 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:04:43.508777 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:04:43.508777 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:04:43.508777 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:04:43.508777 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:04:43.508777 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:04:43.508777 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:04:43.508777 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:04:43.508777 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 18 04:04:43.508777 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:04:43.508777 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 33/66] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Jun 18 04:04:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 04:04:43.509879 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9695e6b-967a-430a-a5b8-5b404d5fd7b5 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:43.509980 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9695e6b-967a-430a-a5b8-5b404d5fd7b5 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:43.512598 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9695e6b-967a-430a-a5b8-5b404d5fd7b5 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:43.512598 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 34/67] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:04:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:04:43.517660 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9695e6b-967a-430a-a5b8-5b404d5fd7b5 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:43.563970 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c847ed2-65bd-477f-b3e3-dcc6bbd14fdb None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:43.599382 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae139f22-5c8f-4bd0-b725-88101bd70068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:43.600225 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae139f22-5c8f-4bd0-b725-88101bd70068 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:43.600878 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae139f22-5c8f-4bd0-b725-88101bd70068 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:43.601161 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae139f22-5c8f-4bd0-b725-88101bd70068 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:43.612196 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae139f22-5c8f-4bd0-b725-88101bd70068 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:04:43.620061 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-ae139f22-5c8f-4bd0-b725-88101bd70068 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 04:04:43.620061 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:04:43.620061 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:04:43.620061 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:04:43.620061 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:04:43.620061 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:04:43.620061 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:04:43.620061 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:04:43.620061 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:04:43.620061 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:04:43.620061 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:04:43.620061 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:04:43.620061 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:04:43.620061 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:04:43.620061 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:04:43.620061 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:04:43.620993 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:04:43.620993 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:04:43.620993 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:04:43.620993 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:04:43.620993 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:04:43.620993 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:04:43.620993 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:04:43.620993 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:04:43.620993 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:04:43.620993 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:04:43.620993 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:04:43.620993 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:04:43.620993 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:04:43.620993 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:04:43.620993 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:04:43.620993 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:04:43.621759 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:04:43.621759 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:04:43.621759 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:04:43.621759 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:04:43.621759 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:04:43.621759 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:04:43.621759 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:04:43.621759 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:04:43.621759 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:04:43.621759 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:04:43.621759 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 04:04:43.621759 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:04:43.621759 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 34/68] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Jun 18 04:04:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:04:43.626346 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4990c-46a5-44a0-a119-fbc5673fb952 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:43.626876 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4990c-46a5-44a0-a119-fbc5673fb952 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:43.627118 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9695e6b-967a-430a-a5b8-5b404d5fd7b5 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:43.627564 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4990c-46a5-44a0-a119-fbc5673fb952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:43.628856 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:43.649379 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-bcf4990c-46a5-44a0-a119-fbc5673fb952 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:04:43.650574 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-bcf4990c-46a5-44a0-a119-fbc5673fb952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:04:43.662057 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2eff9-9aa3-4a56-b569-f3106994132f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:43.662737 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2eff9-9aa3-4a56-b569-f3106994132f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:43.663018 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2eff9-9aa3-4a56-b569-f3106994132f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:43.663295 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2eff9-9aa3-4a56-b569-f3106994132f None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:43.664051 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb2eff9-9aa3-4a56-b569-f3106994132f None admin] RBAC: Adding query filter params (name=member) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:04:43.664358 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb2eff9-9aa3-4a56-b569-f3106994132f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:43.665810 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb2eff9-9aa3-4a56-b569-f3106994132f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:43.677899 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 35/69] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Jun 18 04:04:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:04:43.679130 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6d191-360a-4051-a195-30a317623315 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:43.679419 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6d191-360a-4051-a195-30a317623315 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:43.679693 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6d191-360a-4051-a195-30a317623315 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:43.681159 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 36/70] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:04:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:04:43.685723 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd6d191-360a-4051-a195-30a317623315 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:43.703307 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:43.719967 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 35/71] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:04:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:04:43.721377 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6dbff-e813-4738-8c6e-f2547cfad355 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:43.721666 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6dbff-e813-4738-8c6e-f2547cfad355 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:43.721939 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6dbff-e813-4738-8c6e-f2547cfad355 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:43.723349 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 36/72] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:04:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:04:43.725327 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be6dbff-e813-4738-8c6e-f2547cfad355 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:43.787576 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd6d191-360a-4051-a195-30a317623315 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:43.821258 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04058c62-cb71-4e11-be55-6607bb5b22e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:43.821926 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04058c62-cb71-4e11-be55-6607bb5b22e7 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:43.822206 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04058c62-cb71-4e11-be55-6607bb5b22e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:43.822487 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04058c62-cb71-4e11-be55-6607bb5b22e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:43.823235 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04058c62-cb71-4e11-be55-6607bb5b22e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:04:43.823603 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04058c62-cb71-4e11-be55-6607bb5b22e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:43.825082 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04058c62-cb71-4e11-be55-6607bb5b22e7 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:43.832003 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be6dbff-e813-4738-8c6e-f2547cfad355 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:43.833162 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 37/73] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Jun 18 04:04:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:43.834159 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c3715-7115-431d-8b2f-4a20451f50d0 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:43.835108 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c3715-7115-431d-8b2f-4a20451f50d0 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:43.835108 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c3715-7115-431d-8b2f-4a20451f50d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:43.850536 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-865c3715-7115-431d-8b2f-4a20451f50d0 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:04:43.851731 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-865c3715-7115-431d-8b2f-4a20451f50d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:04:43.866484 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb9869-2e4d-46e1-b7b4-9cc83060151d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:43.867356 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb9869-2e4d-46e1-b7b4-9cc83060151d None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:43.867628 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb9869-2e4d-46e1-b7b4-9cc83060151d None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:43.867897 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb9869-2e4d-46e1-b7b4-9cc83060151d None admin] PATH_INFO: `/v3/users/732d81d4380b4131ac8b88c9215b9c7f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:43.872819 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:43.882585 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb9869-2e4d-46e1-b7b4-9cc83060151d None admin] RBAC: Authorizing `identity:get_user(user_id=732d81d4380b4131ac8b88c9215b9c7f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:43.884060 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb9869-2e4d-46e1-b7b4-9cc83060151d None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:43.885780 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 37/74] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Jun 18 04:04:43 2022] GET /identity/v3/users/732d81d4380b4131ac8b88c9215b9c7f => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:43.887091 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629dbd0-98cc-48fa-b4dc-a13123ca1d34 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:43.887376 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629dbd0-98cc-48fa-b4dc-a13123ca1d34 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:43.887648 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629dbd0-98cc-48fa-b4dc-a13123ca1d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:43.903102 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-3629dbd0-98cc-48fa-b4dc-a13123ca1d34 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:04:43.904280 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-3629dbd0-98cc-48fa-b4dc-a13123ca1d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:04:43.918428 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 38/75] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:04:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:04:43.919295 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c3715-7115-431d-8b2f-4a20451f50d0 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:43.945495 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:43.974736 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 38/76] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:04:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:04:43.975588 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3629dbd0-98cc-48fa-b4dc-a13123ca1d34 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:44.022676 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c3715-7115-431d-8b2f-4a20451f50d0 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:44.056411 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e25b5bc-8459-40c7-9032-1a66a6220040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:44.057169 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25b5bc-8459-40c7-9032-1a66a6220040 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:44.057450 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25b5bc-8459-40c7-9032-1a66a6220040 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:44.057722 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25b5bc-8459-40c7-9032-1a66a6220040 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:44.068241 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e25b5bc-8459-40c7-9032-1a66a6220040 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:04:44.076693 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-8e25b5bc-8459-40c7-9032-1a66a6220040 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 18 04:04:44.076693 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:04:44.076693 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:04:44.076693 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:04:44.076693 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:04:44.076693 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:04:44.076693 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:04:44.076693 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:04:44.076693 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:04:44.076693 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:04:44.076693 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:04:44.076693 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:04:44.076693 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:04:44.076693 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:04:44.076693 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:04:44.076693 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:04:44.077721 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:04:44.077721 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:04:44.077721 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:04:44.077721 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:04:44.077721 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:04:44.077721 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:04:44.077721 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:04:44.077721 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:04:44.077721 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:04:44.077721 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:04:44.077721 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:04:44.077721 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:04:44.077721 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:04:44.077721 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:04:44.077721 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:04:44.077721 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:04:44.079242 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:04:44.079242 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:04:44.079242 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:04:44.079242 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:04:44.079242 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:04:44.079242 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:04:44.079242 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:04:44.079242 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:04:44.079242 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:04:44.079242 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:04:44.079242 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 18 04:04:44.079242 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:04:44.079242 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 39/77] 10.222.0.20 () {56 vars in 1114 bytes} [Sat Jun 18 04:04:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:04:44.079242 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e25b5bc-8459-40c7-9032-1a66a6220040 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:44.084293 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3629dbd0-98cc-48fa-b4dc-a13123ca1d34 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:44.103154 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:44.122761 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b1e5b-24dc-49b9-8cd3-111fb31aeb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:44.123648 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b1e5b-24dc-49b9-8cd3-111fb31aeb24 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:44.123929 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b1e5b-24dc-49b9-8cd3-111fb31aeb24 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:44.124202 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b1e5b-24dc-49b9-8cd3-111fb31aeb24 None admin] PATH_INFO: `/v3/users/7064955bb91f4385a8d5f4c522c8d511` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:44.125446 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b1e5b-24dc-49b9-8cd3-111fb31aeb24 None admin] RBAC: Authorizing `identity:get_user(user_id=7064955bb91f4385a8d5f4c522c8d511)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:44.126954 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b1e5b-24dc-49b9-8cd3-111fb31aeb24 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:44.128594 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 39/78] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Jun 18 04:04:43 2022] GET /identity/v3/users/7064955bb91f4385a8d5f4c522c8d511 => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:44.133121 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b1e5b-24dc-49b9-8cd3-111fb31aeb24 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:44.172590 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:44.189724 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e25b5bc-8459-40c7-9032-1a66a6220040 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:44.224107 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d7cbe-d34f-4817-9e94-118a23a9f33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:44.224786 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d7cbe-d34f-4817-9e94-118a23a9f33c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:44.225097 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d7cbe-d34f-4817-9e94-118a23a9f33c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:44.225423 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d7cbe-d34f-4817-9e94-118a23a9f33c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:44.228031 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b1e5b-24dc-49b9-8cd3-111fb31aeb24 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:44.260666 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a8b1b-7e24-42e9-9919-335a15064853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:44.261457 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a8b1b-7e24-42e9-9919-335a15064853 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:44.261734 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a8b1b-7e24-42e9-9919-335a15064853 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:44.262004 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a8b1b-7e24-42e9-9919-335a15064853 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:44.272023 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a8b1b-7e24-42e9-9919-335a15064853 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:04:44.280051 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-ca4a8b1b-7e24-42e9-9919-335a15064853 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 18 04:04:44.280051 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:04:44.280051 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:04:44.280051 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:04:44.280051 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:04:44.280051 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:04:44.280051 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:04:44.280051 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:04:44.280051 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:04:44.280051 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:04:44.280051 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:04:44.280051 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:04:44.280051 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:04:44.280051 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:04:44.280051 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:04:44.280051 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:04:44.281200 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:04:44.281200 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:04:44.281200 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:04:44.281200 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:04:44.281200 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:04:44.281200 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:04:44.281200 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:04:44.281200 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:04:44.281200 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:04:44.281200 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:04:44.281200 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:04:44.281200 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:04:44.281200 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:04:44.281200 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:04:44.281200 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:04:44.281200 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:04:44.286938 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:04:44.286938 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:04:44.286938 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:04:44.286938 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:04:44.286938 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:04:44.286938 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:04:44.286938 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:04:44.286938 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:04:44.286938 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:04:44.286938 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:04:44.286938 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 18 04:04:44.286938 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:04:44.286938 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 40/79] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Jun 18 04:04:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:04:44.286938 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a8b1b-7e24-42e9-9919-335a15064853 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:44.299427 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816d7cbe-d34f-4817-9e94-118a23a9f33c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:44.300935 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816d7cbe-d34f-4817-9e94-118a23a9f33c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:44.319337 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:44.377770 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a8b1b-7e24-42e9-9919-335a15064853 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:44.379539 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:44.399397 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 40/80] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Jun 18 04:04:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 04:04:44.400235 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d7cbe-d34f-4817-9e94-118a23a9f33c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:44.413510 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d4dd37-4e53-428e-a07d-5a9006228ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:44.414308 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4dd37-4e53-428e-a07d-5a9006228ac0 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:44.414593 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4dd37-4e53-428e-a07d-5a9006228ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:44.414870 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4dd37-4e53-428e-a07d-5a9006228ac0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:44.416075 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d4dd37-4e53-428e-a07d-5a9006228ac0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:44.417658 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d4dd37-4e53-428e-a07d-5a9006228ac0 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:44.423794 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 41/81] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:04:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:44.423794 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d4dd37-4e53-428e-a07d-5a9006228ac0 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:44.498305 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d7cbe-d34f-4817-9e94-118a23a9f33c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:44.514277 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:44.518763 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d4dd37-4e53-428e-a07d-5a9006228ac0 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:44.532648 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a1a92-c402-457a-a2f5-7923dfaa8863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:44.533320 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a1a92-c402-457a-a2f5-7923dfaa8863 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:44.533600 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a1a92-c402-457a-a2f5-7923dfaa8863 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:44.533873 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a1a92-c402-457a-a2f5-7923dfaa8863 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:44.534627 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620a1a92-c402-457a-a2f5-7923dfaa8863 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:04:44.534933 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620a1a92-c402-457a-a2f5-7923dfaa8863 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:44.536316 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620a1a92-c402-457a-a2f5-7923dfaa8863 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:44.544136 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 41/82] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Jun 18 04:04:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:44.544943 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a1a92-c402-457a-a2f5-7923dfaa8863 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:44.551633 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909459f-332e-4600-bf2c-133bdd403073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:44.552282 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909459f-332e-4600-bf2c-133bdd403073 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:44.552560 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909459f-332e-4600-bf2c-133bdd403073 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:44.552857 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909459f-332e-4600-bf2c-133bdd403073 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:44.591972 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:44.622976 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0909459f-332e-4600-bf2c-133bdd403073 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:44.624460 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0909459f-332e-4600-bf2c-133bdd403073 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:44.643424 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a1a92-c402-457a-a2f5-7923dfaa8863 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:44.676135 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea98287c-f094-4221-b20d-7444b39ece31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:44.676827 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea98287c-f094-4221-b20d-7444b39ece31 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:44.677128 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea98287c-f094-4221-b20d-7444b39ece31 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:44.677398 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea98287c-f094-4221-b20d-7444b39ece31 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:44.678139 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea98287c-f094-4221-b20d-7444b39ece31 None admin] RBAC: Adding query filter params (name=member) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:04:44.678443 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea98287c-f094-4221-b20d-7444b39ece31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:44.679804 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea98287c-f094-4221-b20d-7444b39ece31 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:44.687792 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 42/83] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Jun 18 04:04:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:44.688587 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea98287c-f094-4221-b20d-7444b39ece31 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:44.720779 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 42/84] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Jun 18 04:04:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 04:04:44.721679 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909459f-332e-4600-bf2c-133bdd403073 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:44.732697 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:44.790331 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:44.792015 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea98287c-f094-4221-b20d-7444b39ece31 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:44.821883 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909459f-332e-4600-bf2c-133bdd403073 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:44.825158 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6f50d-e659-4eac-a40c-038eb735d511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:44.826029 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6f50d-e659-4eac-a40c-038eb735d511 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:44.826313 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6f50d-e659-4eac-a40c-038eb735d511 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:44.826585 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6f50d-e659-4eac-a40c-038eb735d511 None admin] PATH_INFO: `/v3/projects/594195ae8d4c49c8babdbc7125c60372` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:44.827827 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6f50d-e659-4eac-a40c-038eb735d511 None admin] RBAC: Authorizing `identity:get_project(project_id=594195ae8d4c49c8babdbc7125c60372)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:44.829320 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6f50d-e659-4eac-a40c-038eb735d511 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:44.831028 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 43/85] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Jun 18 04:04:44 2022] GET /identity/v3/projects/594195ae8d4c49c8babdbc7125c60372 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:44.836125 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6f50d-e659-4eac-a40c-038eb735d511 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:44.855414 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3414f5f-6d06-45e7-ad81-3e01ba059403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:44.856017 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3414f5f-6d06-45e7-ad81-3e01ba059403 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:44.856291 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3414f5f-6d06-45e7-ad81-3e01ba059403 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:44.856559 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3414f5f-6d06-45e7-ad81-3e01ba059403 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:44.857306 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3414f5f-6d06-45e7-ad81-3e01ba059403 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:44.858758 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3414f5f-6d06-45e7-ad81-3e01ba059403 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:44.900629 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 43/86] 10.222.0.20 () {60 vars in 1132 bytes} [Sat Jun 18 04:04:44 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 04:04:44.900629 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3414f5f-6d06-45e7-ad81-3e01ba059403 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:44.941630 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6f50d-e659-4eac-a40c-038eb735d511 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:44.952270 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:44.988308 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd3ce5d-0782-46d5-84fe-f4236fe66ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:44.989333 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd3ce5d-0782-46d5-84fe-f4236fe66ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:44.989683 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd3ce5d-0782-46d5-84fe-f4236fe66ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:44.990046 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd3ce5d-0782-46d5-84fe-f4236fe66ff6 None admin] PATH_INFO: `/v3/users/732d81d4380b4131ac8b88c9215b9c7f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:44.991314 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd3ce5d-0782-46d5-84fe-f4236fe66ff6 None admin] RBAC: Authorizing `identity:get_user(user_id=732d81d4380b4131ac8b88c9215b9c7f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:44.992861 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd3ce5d-0782-46d5-84fe-f4236fe66ff6 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:44.994808 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 44/87] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Jun 18 04:04:44 2022] GET /identity/v3/users/732d81d4380b4131ac8b88c9215b9c7f => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:44.995644 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd3ce5d-0782-46d5-84fe-f4236fe66ff6 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:45.012122 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3414f5f-6d06-45e7-ad81-3e01ba059403 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:45.042362 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:45.055748 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8be76-f5b6-40a7-a0a0-91eba4a4f239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:45.056987 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8be76-f5b6-40a7-a0a0-91eba4a4f239 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:45.057272 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8be76-f5b6-40a7-a0a0-91eba4a4f239 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:45.057557 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8be76-f5b6-40a7-a0a0-91eba4a4f239 None admin] PATH_INFO: `/v3/users/732d81d4380b4131ac8b88c9215b9c7f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:45.060563 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb8be76-f5b6-40a7-a0a0-91eba4a4f239 None admin] RBAC: Authorizing `identity:get_user(user_id=732d81d4380b4131ac8b88c9215b9c7f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:45.062095 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb8be76-f5b6-40a7-a0a0-91eba4a4f239 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:45.063944 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 44/88] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Jun 18 04:04:44 2022] GET /identity/v3/users/732d81d4380b4131ac8b88c9215b9c7f => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:45.065245 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8be76-f5b6-40a7-a0a0-91eba4a4f239 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:45.120834 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd3ce5d-0782-46d5-84fe-f4236fe66ff6 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:45.164953 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4017a-02e7-47a3-82e9-c411c8872181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:45.165840 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4017a-02e7-47a3-82e9-c411c8872181 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:45.166121 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4017a-02e7-47a3-82e9-c411c8872181 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:45.166398 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4017a-02e7-47a3-82e9-c411c8872181 None admin] PATH_INFO: `/v3/projects/594195ae8d4c49c8babdbc7125c60372` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:45.167711 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d4017a-02e7-47a3-82e9-c411c8872181 None admin] RBAC: Authorizing `identity:get_project(project_id=594195ae8d4c49c8babdbc7125c60372)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:45.169271 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d4017a-02e7-47a3-82e9-c411c8872181 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:45.171034 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 45/89] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Jun 18 04:04:44 2022] GET /identity/v3/projects/594195ae8d4c49c8babdbc7125c60372 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:45.171819 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4017a-02e7-47a3-82e9-c411c8872181 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:45.187308 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8be76-f5b6-40a7-a0a0-91eba4a4f239 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:45.229402 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485761e9-fdbf-4aa3-8532-912ffd7afeb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:45.230463 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485761e9-fdbf-4aa3-8532-912ffd7afeb2 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:45.230748 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485761e9-fdbf-4aa3-8532-912ffd7afeb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:45.231026 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485761e9-fdbf-4aa3-8532-912ffd7afeb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:45.231883 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485761e9-fdbf-4aa3-8532-912ffd7afeb2 None admin] RBAC: Adding query filter params (role.id=d74f7ad64e584e6186564837fa3cf380, scope.project.id=594195ae8d4c49c8babdbc7125c60372, user.id=732d81d4380b4131ac8b88c9215b9c7f) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:04:45.232223 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485761e9-fdbf-4aa3-8532-912ffd7afeb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:45.233748 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485761e9-fdbf-4aa3-8532-912ffd7afeb2 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:45.240255 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 45/90] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Jun 18 04:04:45 2022] GET /identity/v3/role_assignments?user.id=732d81d4380b4131ac8b88c9215b9c7f&scope.project.id=594195ae8d4c49c8babdbc7125c60372&role.id=d74f7ad64e584e6186564837fa3cf380 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:45.240796 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:45.241067 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485761e9-fdbf-4aa3-8532-912ffd7afeb2 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:45.316507 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:45.390413 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485761e9-fdbf-4aa3-8532-912ffd7afeb2 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:45.405980 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4017a-02e7-47a3-82e9-c411c8872181 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:45.457990 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2881930d-5b96-4f64-b514-226ced3f3d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:45.459274 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881930d-5b96-4f64-b514-226ced3f3d3a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:45.460185 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881930d-5b96-4f64-b514-226ced3f3d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:45.460831 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881930d-5b96-4f64-b514-226ced3f3d3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:45.466616 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9efa94-4ff2-4d53-b298-f7f6e0d4e355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:45.467289 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9efa94-4ff2-4d53-b298-f7f6e0d4e355 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:45.468747 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9efa94-4ff2-4d53-b298-f7f6e0d4e355 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:45.469034 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9efa94-4ff2-4d53-b298-f7f6e0d4e355 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:45.589927 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9efa94-4ff2-4d53-b298-f7f6e0d4e355 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:45.591414 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9efa94-4ff2-4d53-b298-f7f6e0d4e355 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:45.596772 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2881930d-5b96-4f64-b514-226ced3f3d3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:45.598249 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2881930d-5b96-4f64-b514-226ced3f3d3a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:45.679479 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:45.691062 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:45.738325 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 46/91] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Jun 18 04:04:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 04:04:45.743507 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2881930d-5b96-4f64-b514-226ced3f3d3a None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:45.828114 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 46/92] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Jun 18 04:04:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 657 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 04:04:45.829020 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9efa94-4ff2-4d53-b298-f7f6e0d4e355 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:45.872530 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2881930d-5b96-4f64-b514-226ced3f3d3a None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:45.932861 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da05c835-3792-4c19-90d0-217a91a3dcad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:45.933599 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05c835-3792-4c19-90d0-217a91a3dcad None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:45.933925 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05c835-3792-4c19-90d0-217a91a3dcad None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:45.934199 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05c835-3792-4c19-90d0-217a91a3dcad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:45.935033 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da05c835-3792-4c19-90d0-217a91a3dcad None admin] RBAC: Adding query filter params (role.id=d783a633c75847d48ef7ef5b169b0313, scope.project.id=594195ae8d4c49c8babdbc7125c60372, user.id=7064955bb91f4385a8d5f4c522c8d511) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:04:45.935338 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da05c835-3792-4c19-90d0-217a91a3dcad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:45.936819 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da05c835-3792-4c19-90d0-217a91a3dcad None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:45.946762 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 47/93] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Jun 18 04:04:45 2022] GET /identity/v3/role_assignments?user.id=7064955bb91f4385a8d5f4c522c8d511&scope.project.id=594195ae8d4c49c8babdbc7125c60372&role.id=d783a633c75847d48ef7ef5b169b0313 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:45.950057 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da05c835-3792-4c19-90d0-217a91a3dcad None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:46.005876 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:46.023416 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9efa94-4ff2-4d53-b298-f7f6e0d4e355 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:46.093374 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed69dcd0-15f2-4b5f-a7f7-016fd18b4e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:46.096504 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69dcd0-15f2-4b5f-a7f7-016fd18b4e32 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:46.096814 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69dcd0-15f2-4b5f-a7f7-016fd18b4e32 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:46.097074 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69dcd0-15f2-4b5f-a7f7-016fd18b4e32 None admin] PATH_INFO: `/v3/projects/a709e1adfafe4068bb500cc3bec8353e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:46.099658 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed69dcd0-15f2-4b5f-a7f7-016fd18b4e32 None admin] RBAC: Authorizing `identity:get_project(project_id=a709e1adfafe4068bb500cc3bec8353e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:46.109298 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed69dcd0-15f2-4b5f-a7f7-016fd18b4e32 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:46.111506 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 47/94] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Jun 18 04:04:45 2022] GET /identity/v3/projects/a709e1adfafe4068bb500cc3bec8353e => generated 312 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:46.117497 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed69dcd0-15f2-4b5f-a7f7-016fd18b4e32 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:46.135724 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:46.183901 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da05c835-3792-4c19-90d0-217a91a3dcad None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:46.294299 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc11a4-66b8-41c4-9274-663b4621a7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:46.296008 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc11a4-66b8-41c4-9274-663b4621a7a9 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:46.296495 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc11a4-66b8-41c4-9274-663b4621a7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:46.297010 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc11a4-66b8-41c4-9274-663b4621a7a9 None admin] PATH_INFO: `/v3/projects/594195ae8d4c49c8babdbc7125c60372` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:46.297723 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed69dcd0-15f2-4b5f-a7f7-016fd18b4e32 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:46.298647 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbc11a4-66b8-41c4-9274-663b4621a7a9 None admin] RBAC: Authorizing `identity:get_project(project_id=594195ae8d4c49c8babdbc7125c60372)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:46.300300 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbc11a4-66b8-41c4-9274-663b4621a7a9 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:46.302297 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 48/95] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Jun 18 04:04:45 2022] GET /identity/v3/projects/594195ae8d4c49c8babdbc7125c60372 => generated 298 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:46.309530 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc11a4-66b8-41c4-9274-663b4621a7a9 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:46.357842 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfb55a0-bf0d-4e15-b4b8-09148dc86851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:46.358512 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb55a0-bf0d-4e15-b4b8-09148dc86851 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:46.358796 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb55a0-bf0d-4e15-b4b8-09148dc86851 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:46.359073 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb55a0-bf0d-4e15-b4b8-09148dc86851 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:46.360292 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfb55a0-bf0d-4e15-b4b8-09148dc86851 None admin] RBAC: Adding query filter params (role.id=d74f7ad64e584e6186564837fa3cf380, scope.project.id=a709e1adfafe4068bb500cc3bec8353e, user.id=732d81d4380b4131ac8b88c9215b9c7f) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:04:46.360631 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfb55a0-bf0d-4e15-b4b8-09148dc86851 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:46.362087 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfb55a0-bf0d-4e15-b4b8-09148dc86851 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:46.378768 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 48/96] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Jun 18 04:04:46 2022] GET /identity/v3/role_assignments?user.id=732d81d4380b4131ac8b88c9215b9c7f&scope.project.id=a709e1adfafe4068bb500cc3bec8353e&role.id=d74f7ad64e584e6186564837fa3cf380 => generated 259 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:04:46.435856 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:46.451312 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc11a4-66b8-41c4-9274-663b4621a7a9 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:46.489218 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322fdebe-c98a-457d-8d7d-eff0eaa46214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:46.489890 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fdebe-c98a-457d-8d7d-eff0eaa46214 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:46.490175 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fdebe-c98a-457d-8d7d-eff0eaa46214 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:46.490459 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fdebe-c98a-457d-8d7d-eff0eaa46214 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:46.491306 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322fdebe-c98a-457d-8d7d-eff0eaa46214 None admin] RBAC: Adding query filter params (role.id=ba29217afc57483a90e90b287c480549, scope.project.id=594195ae8d4c49c8babdbc7125c60372, user.id=732d81d4380b4131ac8b88c9215b9c7f) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:04:46.491622 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322fdebe-c98a-457d-8d7d-eff0eaa46214 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:46.493193 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322fdebe-c98a-457d-8d7d-eff0eaa46214 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:46.499009 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 49/97] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Jun 18 04:04:46 2022] GET /identity/v3/role_assignments?user.id=732d81d4380b4131ac8b88c9215b9c7f&scope.project.id=594195ae8d4c49c8babdbc7125c60372&role.id=ba29217afc57483a90e90b287c480549 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:47.359073 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c4ab1-8efe-4a0b-9aad-d8c834fbd100 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:47.359924 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c4ab1-8efe-4a0b-9aad-d8c834fbd100 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:47.359924 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c4ab1-8efe-4a0b-9aad-d8c834fbd100 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:47.361353 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 49/98] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:04:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:04:47.366702 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605a07d-18ea-4a58-bb91-ff3104ab1fda None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:47.367535 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605a07d-18ea-4a58-bb91-ff3104ab1fda None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:47.368005 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605a07d-18ea-4a58-bb91-ff3104ab1fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:47.397588 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-2605a07d-18ea-4a58-bb91-ff3104ab1fda None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:04:47.399125 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-2605a07d-18ea-4a58-bb91-ff3104ab1fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:04:47.439840 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b7555-4d4a-423f-91a9-6d811dc56639 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:47.440495 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b7555-4d4a-423f-91a9-6d811dc56639 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:47.441024 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b7555-4d4a-423f-91a9-6d811dc56639 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:47.442623 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 50/99] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:04:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 18 04:04:47.448208 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3915d-375e-41e9-9c58-aa6aa50d76a4 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:47.448846 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3915d-375e-41e9-9c58-aa6aa50d76a4 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:47.449352 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3915d-375e-41e9-9c58-aa6aa50d76a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:47.467171 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-dea3915d-375e-41e9-9c58-aa6aa50d76a4 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:04:47.468789 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-dea3915d-375e-41e9-9c58-aa6aa50d76a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:04:47.490578 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 50/100] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:04:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 18 04:04:47.543881 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2605a07d-18ea-4a58-bb91-ff3104ab1fda None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:47.555671 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 51/101] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:04:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:04:47.579111 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea3915d-375e-41e9-9c58-aa6aa50d76a4 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:47.588157 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:47.662056 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:47.679689 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2605a07d-18ea-4a58-bb91-ff3104ab1fda None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:47.715182 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dddfdcb-366b-42bd-91e4-1e6919cef796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:47.716344 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dddfdcb-366b-42bd-91e4-1e6919cef796 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:47.716857 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dddfdcb-366b-42bd-91e4-1e6919cef796 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:47.717341 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dddfdcb-366b-42bd-91e4-1e6919cef796 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:47.723162 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea3915d-375e-41e9-9c58-aa6aa50d76a4 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:47.728650 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dddfdcb-366b-42bd-91e4-1e6919cef796 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:04:47.746161 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-6dddfdcb-366b-42bd-91e4-1e6919cef796 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 18 04:04:47.746161 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:04:47.746161 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:04:47.746161 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:04:47.746161 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:04:47.746161 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:04:47.746161 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:04:47.746161 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:04:47.746161 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:04:47.746161 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:04:47.746161 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:04:47.746161 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:04:47.746161 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:04:47.746161 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:04:47.746161 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:04:47.746161 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:04:47.747025 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:04:47.747025 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:04:47.747025 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:04:47.747025 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:04:47.747025 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:04:47.747025 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:04:47.747025 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:04:47.747025 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:04:47.747025 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:04:47.747025 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:04:47.747025 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:04:47.747025 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:04:47.747025 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:04:47.747025 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:04:47.747025 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:04:47.747025 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:04:47.747836 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:04:47.747836 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:04:47.747836 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:04:47.747836 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:04:47.747836 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:04:47.747836 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:04:47.747836 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:04:47.747836 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:04:47.747836 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:04:47.747836 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:04:47.747836 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 18 04:04:47.747836 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:04:47.750262 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 51/102] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Jun 18 04:04:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:04:47.757928 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dddfdcb-366b-42bd-91e4-1e6919cef796 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:47.759816 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c099ae3-0944-4ae5-b039-4ef90143e158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:47.761096 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c099ae3-0944-4ae5-b039-4ef90143e158 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:47.761598 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c099ae3-0944-4ae5-b039-4ef90143e158 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:47.762010 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c099ae3-0944-4ae5-b039-4ef90143e158 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:47.763876 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c099ae3-0944-4ae5-b039-4ef90143e158 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:47.765531 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c099ae3-0944-4ae5-b039-4ef90143e158 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:47.767422 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 52/103] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:04:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:04:47.772993 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c099ae3-0944-4ae5-b039-4ef90143e158 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:47.918222 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:47.946118 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dddfdcb-366b-42bd-91e4-1e6919cef796 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:47.983091 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c099ae3-0944-4ae5-b039-4ef90143e158 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:47.992301 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4987d00e-9147-4a8e-a81b-607675e1c725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:47.993189 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987d00e-9147-4a8e-a81b-607675e1c725 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:47.993602 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987d00e-9147-4a8e-a81b-607675e1c725 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:47.994006 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987d00e-9147-4a8e-a81b-607675e1c725 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:47.994919 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4987d00e-9147-4a8e-a81b-607675e1c725 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:04:47.995557 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4987d00e-9147-4a8e-a81b-607675e1c725 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:47.998717 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4987d00e-9147-4a8e-a81b-607675e1c725 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:48.013944 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 52/104] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Jun 18 04:04:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:48.016406 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed790938-d42c-4cea-928d-c5cade58d973 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:48.018854 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed790938-d42c-4cea-928d-c5cade58d973 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:48.019329 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed790938-d42c-4cea-928d-c5cade58d973 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:48.020832 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 53/105] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:04:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:04:48.021894 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed790938-d42c-4cea-928d-c5cade58d973 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:48.036608 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:48.056978 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53008ea-49ff-4980-a2f7-75f2be4b18f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:48.058155 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53008ea-49ff-4980-a2f7-75f2be4b18f3 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:48.058808 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53008ea-49ff-4980-a2f7-75f2be4b18f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:48.059940 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53008ea-49ff-4980-a2f7-75f2be4b18f3 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:48.061700 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53008ea-49ff-4980-a2f7-75f2be4b18f3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:48.063487 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53008ea-49ff-4980-a2f7-75f2be4b18f3 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:48.117811 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 53/106] 10.222.0.20 () {60 vars in 1141 bytes} [Sat Jun 18 04:04:47 2022] POST /identity/v3/projects => generated 302 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 04:04:48.124600 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eedb68-7e02-4b06-9d14-25cb3dc0c6cf None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:48.125400 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eedb68-7e02-4b06-9d14-25cb3dc0c6cf None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:48.125869 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eedb68-7e02-4b06-9d14-25cb3dc0c6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:48.152593 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-47eedb68-7e02-4b06-9d14-25cb3dc0c6cf None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:04:48.154149 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-47eedb68-7e02-4b06-9d14-25cb3dc0c6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:04:48.217899 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed790938-d42c-4cea-928d-c5cade58d973 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:48.238264 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 54/107] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:04:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:04:48.261512 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eedb68-7e02-4b06-9d14-25cb3dc0c6cf None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:48.287187 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21d410-f631-4587-b89a-1ee186fbd898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:48.288095 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21d410-f631-4587-b89a-1ee186fbd898 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:48.288376 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21d410-f631-4587-b89a-1ee186fbd898 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:48.288680 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21d410-f631-4587-b89a-1ee186fbd898 None admin] PATH_INFO: `/v3/users/adb92e9a455f4a6498d4e82112f55eb9` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:48.322733 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe21d410-f631-4587-b89a-1ee186fbd898 None admin] RBAC: Authorizing `identity:get_user(user_id=adb92e9a455f4a6498d4e82112f55eb9)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:48.324345 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe21d410-f631-4587-b89a-1ee186fbd898 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:48.324956 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:48.326216 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 54/108] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Jun 18 04:04:48 2022] GET /identity/v3/users/adb92e9a455f4a6498d4e82112f55eb9 => generated 289 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:48.332088 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21d410-f631-4587-b89a-1ee186fbd898 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:48.376414 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eedb68-7e02-4b06-9d14-25cb3dc0c6cf None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:48.455909 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:48.461456 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e07571-ed19-436f-8194-b67da0fa554d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:48.462302 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e07571-ed19-436f-8194-b67da0fa554d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:48.462759 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e07571-ed19-436f-8194-b67da0fa554d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:48.463188 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e07571-ed19-436f-8194-b67da0fa554d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:48.477860 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e07571-ed19-436f-8194-b67da0fa554d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:04:48.488747 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-c9e07571-ed19-436f-8194-b67da0fa554d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 18 04:04:48.488747 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:04:48.488747 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:04:48.488747 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:04:48.488747 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:04:48.488747 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:04:48.488747 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:04:48.488747 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:04:48.488747 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:04:48.488747 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:04:48.488747 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:04:48.488747 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:04:48.488747 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:04:48.488747 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:04:48.488747 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:04:48.488747 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:04:48.489835 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:04:48.489835 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:04:48.489835 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:04:48.489835 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:04:48.489835 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:04:48.489835 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:04:48.489835 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:04:48.489835 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:04:48.489835 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:04:48.489835 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:04:48.489835 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:04:48.489835 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:04:48.489835 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:04:48.489835 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:04:48.489835 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:04:48.489835 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:04:48.490800 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:04:48.490800 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:04:48.490800 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:04:48.490800 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:04:48.490800 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:04:48.490800 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:04:48.490800 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:04:48.490800 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:04:48.490800 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:04:48.490800 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:04:48.490800 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 18 04:04:48.490800 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:04:48.492883 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 55/109] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Jun 18 04:04:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 04:04:48.498769 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e07571-ed19-436f-8194-b67da0fa554d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:48.518848 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21d410-f631-4587-b89a-1ee186fbd898 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:48.586501 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c7ecf-0655-40ab-9a55-7a552b2d5709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:48.587189 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c7ecf-0655-40ab-9a55-7a552b2d5709 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:48.587473 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c7ecf-0655-40ab-9a55-7a552b2d5709 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:48.587747 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c7ecf-0655-40ab-9a55-7a552b2d5709 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:48.612071 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e07571-ed19-436f-8194-b67da0fa554d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:48.636951 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:48.648428 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a756a-cea6-4b2e-9c9a-5c7d9ab24e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:48.649396 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a756a-cea6-4b2e-9c9a-5c7d9ab24e73 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:48.649854 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a756a-cea6-4b2e-9c9a-5c7d9ab24e73 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:48.650295 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a756a-cea6-4b2e-9c9a-5c7d9ab24e73 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:48.651224 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608a756a-cea6-4b2e-9c9a-5c7d9ab24e73 None admin] RBAC: Adding query filter params (name=member) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:04:48.651781 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608a756a-cea6-4b2e-9c9a-5c7d9ab24e73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:48.654199 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608a756a-cea6-4b2e-9c9a-5c7d9ab24e73 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:48.663627 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 56/110] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Jun 18 04:04:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:04:48.673623 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a756a-cea6-4b2e-9c9a-5c7d9ab24e73 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:48.730873 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c7ecf-0655-40ab-9a55-7a552b2d5709 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:48.732293 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c7ecf-0655-40ab-9a55-7a552b2d5709 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:48.798670 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a756a-cea6-4b2e-9c9a-5c7d9ab24e73 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:48.839928 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ddd7a2-7cd9-4915-abf8-f03c61e5c5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:48.840857 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ddd7a2-7cd9-4915-abf8-f03c61e5c5d5 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:48.841139 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ddd7a2-7cd9-4915-abf8-f03c61e5c5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:48.841438 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ddd7a2-7cd9-4915-abf8-f03c61e5c5d5 None admin] PATH_INFO: `/v3/users/732d81d4380b4131ac8b88c9215b9c7f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:48.843103 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ddd7a2-7cd9-4915-abf8-f03c61e5c5d5 None admin] RBAC: Authorizing `identity:get_user(user_id=732d81d4380b4131ac8b88c9215b9c7f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:48.845473 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ddd7a2-7cd9-4915-abf8-f03c61e5c5d5 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:48.847489 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 57/111] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Jun 18 04:04:48 2022] GET /identity/v3/users/732d81d4380b4131ac8b88c9215b9c7f => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:48.853496 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ddd7a2-7cd9-4915-abf8-f03c61e5c5d5 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:48.873872 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:48.909971 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:48.971601 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 55/112] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Jun 18 04:04:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 640 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 18 04:04:48.972063 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ddd7a2-7cd9-4915-abf8-f03c61e5c5d5 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:48.978583 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c7ecf-0655-40ab-9a55-7a552b2d5709 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:49.020101 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb64172-dfc3-418a-9389-011bbb6e39a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:49.020977 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb64172-dfc3-418a-9389-011bbb6e39a4 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:49.021258 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb64172-dfc3-418a-9389-011bbb6e39a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:49.021534 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb64172-dfc3-418a-9389-011bbb6e39a4 None admin] PATH_INFO: `/v3/projects/594195ae8d4c49c8babdbc7125c60372` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:49.024400 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb64172-dfc3-418a-9389-011bbb6e39a4 None admin] RBAC: Authorizing `identity:get_project(project_id=594195ae8d4c49c8babdbc7125c60372)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:49.026777 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb64172-dfc3-418a-9389-011bbb6e39a4 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:49.028706 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 58/113] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Jun 18 04:04:48 2022] GET /identity/v3/projects/594195ae8d4c49c8babdbc7125c60372 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:04:49.054076 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb64172-dfc3-418a-9389-011bbb6e39a4 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:49.159065 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c7ecf-0655-40ab-9a55-7a552b2d5709 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:49.222428 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d584d7-415d-46f1-a94e-9292258726d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:49.224779 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d584d7-415d-46f1-a94e-9292258726d9 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:49.225065 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d584d7-415d-46f1-a94e-9292258726d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:49.225339 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d584d7-415d-46f1-a94e-9292258726d9 None admin] PATH_INFO: `/v3/projects/594195ae8d4c49c8babdbc7125c60372` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:49.228732 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d584d7-415d-46f1-a94e-9292258726d9 None admin] RBAC: Authorizing `identity:get_project(project_id=594195ae8d4c49c8babdbc7125c60372)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:49.230303 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d584d7-415d-46f1-a94e-9292258726d9 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:49.232241 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 56/114] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Jun 18 04:04:48 2022] GET /identity/v3/projects/594195ae8d4c49c8babdbc7125c60372 => generated 298 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:04:49.236470 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb64172-dfc3-418a-9389-011bbb6e39a4 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:49.239339 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699d798-0109-461b-ab85-192392d52d95 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:49.239625 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699d798-0109-461b-ab85-192392d52d95 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:49.239902 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699d798-0109-461b-ab85-192392d52d95 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:49.241388 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 57/115] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:04:49 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:04:49.246909 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b699d798-0109-461b-ab85-192392d52d95 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:49.266913 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:49.293373 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1552782-3223-41f8-9e4d-287402ed9132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:49.294243 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1552782-3223-41f8-9e4d-287402ed9132 None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:49.294528 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1552782-3223-41f8-9e4d-287402ed9132 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:49.294803 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1552782-3223-41f8-9e4d-287402ed9132 None admin] PATH_INFO: `/v3/projects/594195ae8d4c49c8babdbc7125c60372/users/732d81d4380b4131ac8b88c9215b9c7f/roles/d74f7ad64e584e6186564837fa3cf380` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:49.298569 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1552782-3223-41f8-9e4d-287402ed9132 None admin] RBAC: Authorizing `identity:create_grant(project_id=594195ae8d4c49c8babdbc7125c60372, user_id=732d81d4380b4131ac8b88c9215b9c7f, role_id=d74f7ad64e584e6186564837fa3cf380)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:49.300771 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1552782-3223-41f8-9e4d-287402ed9132 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:49.315700 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:49.331135 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 59/116] 10.222.0.20 () {58 vars in 1439 bytes} [Sat Jun 18 04:04:49 2022] PUT /identity/v3/projects/594195ae8d4c49c8babdbc7125c60372/users/732d81d4380b4131ac8b88c9215b9c7f/roles/d74f7ad64e584e6186564837fa3cf380 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 04:04:49.332233 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f1c09-d35e-4f8b-8e20-362cc995ba95 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:49.332528 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f1c09-d35e-4f8b-8e20-362cc995ba95 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:49.332987 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f1c09-d35e-4f8b-8e20-362cc995ba95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:49.384135 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-0a8f1c09-d35e-4f8b-8e20-362cc995ba95 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:04:49.385521 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-0a8f1c09-d35e-4f8b-8e20-362cc995ba95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:04:49.470681 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b699d798-0109-461b-ab85-192392d52d95 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:49.535598 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dab34f-7bd3-42b8-88b8-bd2aac6671db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:49.536515 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dab34f-7bd3-42b8-88b8-bd2aac6671db None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:49.536922 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dab34f-7bd3-42b8-88b8-bd2aac6671db None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:49.537219 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dab34f-7bd3-42b8-88b8-bd2aac6671db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:49.538084 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dab34f-7bd3-42b8-88b8-bd2aac6671db None admin] RBAC: Adding query filter params (role.id=3af5984773ef41448b3d4ef5e617e090, scope.project.id=594195ae8d4c49c8babdbc7125c60372, user.id=adb92e9a455f4a6498d4e82112f55eb9) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:04:49.538428 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dab34f-7bd3-42b8-88b8-bd2aac6671db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:49.544981 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dab34f-7bd3-42b8-88b8-bd2aac6671db None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:49.555396 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 58/117] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Jun 18 04:04:49 2022] GET /identity/v3/role_assignments?user.id=adb92e9a455f4a6498d4e82112f55eb9&scope.project.id=594195ae8d4c49c8babdbc7125c60372&role.id=3af5984773ef41448b3d4ef5e617e090 => generated 259 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:49.577159 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 60/118] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:04:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:04:49.612864 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dab34f-7bd3-42b8-88b8-bd2aac6671db None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:49.665974 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c3bcd-3bfe-4099-84f7-f1fa70bd56dd None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:49.666322 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c3bcd-3bfe-4099-84f7-f1fa70bd56dd None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:49.666542 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c3bcd-3bfe-4099-84f7-f1fa70bd56dd None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:49.668073 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 61/119] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:04:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 18 04:04:49.675187 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d8de3-7fa4-4d6e-b204-af34ada1993d None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:49.675475 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d8de3-7fa4-4d6e-b204-af34ada1993d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:49.676047 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d8de3-7fa4-4d6e-b204-af34ada1993d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:49.706108 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-2c2d8de3-7fa4-4d6e-b204-af34ada1993d None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:04:49.707337 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2c2d8de3-7fa4-4d6e-b204-af34ada1993d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:04:49.779063 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:49.800459 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dab34f-7bd3-42b8-88b8-bd2aac6671db None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:49.849966 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 62/120] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:04:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:04:49.859250 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ebea3f-bbb5-49b7-a245-7fcbf3f478ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:49.860485 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebea3f-bbb5-49b7-a245-7fcbf3f478ab None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:49.860796 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebea3f-bbb5-49b7-a245-7fcbf3f478ab None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:49.861069 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebea3f-bbb5-49b7-a245-7fcbf3f478ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:49.881972 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ebea3f-bbb5-49b7-a245-7fcbf3f478ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:04:49.886226 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d8de3-7fa4-4d6e-b204-af34ada1993d None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:49.897073 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-88ebea3f-bbb5-49b7-a245-7fcbf3f478ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 04:04:49.897073 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:04:49.897073 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:04:49.897073 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:04:49.897073 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:04:49.897073 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:04:49.897073 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:04:49.897073 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:04:49.897073 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:04:49.897073 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:04:49.897073 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:04:49.897073 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:04:49.897073 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:04:49.897073 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:04:49.897073 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:04:49.897073 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:04:49.898002 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:04:49.898002 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:04:49.898002 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:04:49.898002 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:04:49.898002 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:04:49.898002 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:04:49.898002 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:04:49.898002 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:04:49.898002 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:04:49.898002 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:04:49.898002 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:04:49.898002 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:04:49.898002 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:04:49.898002 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:04:49.898002 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:04:49.898002 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:04:49.898767 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:04:49.898767 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:04:49.898767 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:04:49.898767 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:04:49.898767 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:04:49.898767 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:04:49.898767 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:04:49.898767 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:04:49.898767 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:04:49.898767 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:04:49.898767 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 04:04:49.898767 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:04:49.898767 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 59/121] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Jun 18 04:04:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:04:49.900023 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66b353-76d7-4d8c-bf17-37fda694c2c5 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:49.900023 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66b353-76d7-4d8c-bf17-37fda694c2c5 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:49.900322 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66b353-76d7-4d8c-bf17-37fda694c2c5 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:49.901433 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 60/122] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:04:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:04:49.910005 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504af9e-b5c2-427d-80dc-804697a5d7a2 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:49.910292 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504af9e-b5c2-427d-80dc-804697a5d7a2 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:49.910578 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504af9e-b5c2-427d-80dc-804697a5d7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:49.925530 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:49.941606 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-6504af9e-b5c2-427d-80dc-804697a5d7a2 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:04:49.942821 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-6504af9e-b5c2-427d-80dc-804697a5d7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:04:50.047209 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d8de3-7fa4-4d6e-b204-af34ada1993d None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:50.092900 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 61/123] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:04:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:04:50.097568 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6504af9e-b5c2-427d-80dc-804697a5d7a2 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:50.131164 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce38f078-110c-40e6-9394-74a9449b0b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:50.132037 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38f078-110c-40e6-9394-74a9449b0b07 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:50.132317 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38f078-110c-40e6-9394-74a9449b0b07 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:50.136710 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38f078-110c-40e6-9394-74a9449b0b07 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:50.164115 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce38f078-110c-40e6-9394-74a9449b0b07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:04:50.172049 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-ce38f078-110c-40e6-9394-74a9449b0b07 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 18 04:04:50.172049 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:04:50.172049 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:04:50.172049 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:04:50.172049 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:04:50.172049 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:04:50.172049 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:04:50.172049 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:04:50.172049 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:04:50.172049 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:04:50.172049 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:04:50.172049 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:04:50.172049 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:04:50.172049 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:04:50.172049 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:04:50.172049 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:04:50.174071 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:04:50.174071 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:04:50.174071 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:04:50.174071 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:04:50.174071 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:04:50.174071 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:04:50.174071 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:04:50.174071 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:04:50.174071 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:04:50.174071 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:04:50.174071 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:04:50.174071 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:04:50.174071 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:04:50.174071 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:04:50.174071 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:04:50.174071 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:04:50.175906 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:04:50.175906 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:04:50.175906 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:04:50.175906 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:04:50.175906 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:04:50.175906 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:04:50.175906 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:04:50.175906 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:04:50.175906 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:04:50.175906 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:04:50.175906 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 18 04:04:50.175906 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:04:50.180593 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 63/124] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Jun 18 04:04:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:04:50.194574 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce38f078-110c-40e6-9394-74a9449b0b07 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:50.235282 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:50.253151 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6504af9e-b5c2-427d-80dc-804697a5d7a2 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:50.291287 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c4e6b-e435-4e4a-a9dd-e9f70860cb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:50.292483 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c4e6b-e435-4e4a-a9dd-e9f70860cb01 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:50.293087 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c4e6b-e435-4e4a-a9dd-e9f70860cb01 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:50.293561 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c4e6b-e435-4e4a-a9dd-e9f70860cb01 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:50.294500 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c4e6b-e435-4e4a-a9dd-e9f70860cb01 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:04:50.295006 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c4e6b-e435-4e4a-a9dd-e9f70860cb01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:50.296732 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c4e6b-e435-4e4a-a9dd-e9f70860cb01 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:50.305672 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 62/125] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Jun 18 04:04:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:50.306804 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c4e6b-e435-4e4a-a9dd-e9f70860cb01 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:50.354256 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:50.374743 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce38f078-110c-40e6-9394-74a9449b0b07 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:50.411615 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c4e6b-e435-4e4a-a9dd-e9f70860cb01 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:50.446372 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b7c2fc-5d03-4a33-a7c0-d0bc464a5f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:50.447404 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b7c2fc-5d03-4a33-a7c0-d0bc464a5f45 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:50.447894 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b7c2fc-5d03-4a33-a7c0-d0bc464a5f45 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:50.448452 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b7c2fc-5d03-4a33-a7c0-d0bc464a5f45 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:50.449413 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b7c2fc-5d03-4a33-a7c0-d0bc464a5f45 None admin] RBAC: Adding query filter params (name=member) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:04:50.450020 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b7c2fc-5d03-4a33-a7c0-d0bc464a5f45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:50.451592 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b7c2fc-5d03-4a33-a7c0-d0bc464a5f45 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:50.460668 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 63/126] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Jun 18 04:04:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:50.465744 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b7c2fc-5d03-4a33-a7c0-d0bc464a5f45 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:50.466900 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8eda12-006e-4d5f-9f5e-d5552cca1c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:50.467382 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8eda12-006e-4d5f-9f5e-d5552cca1c10 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:50.467572 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8eda12-006e-4d5f-9f5e-d5552cca1c10 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:50.467817 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8eda12-006e-4d5f-9f5e-d5552cca1c10 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:50.485148 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:50.517448 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8eda12-006e-4d5f-9f5e-d5552cca1c10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:04:50.525527 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-dd8eda12-006e-4d5f-9f5e-d5552cca1c10 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 18 04:04:50.525527 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:04:50.525527 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:04:50.525527 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:04:50.525527 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:04:50.525527 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:04:50.525527 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:04:50.525527 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:04:50.525527 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:04:50.525527 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:04:50.525527 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:04:50.525527 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:04:50.525527 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:04:50.525527 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:04:50.525527 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:04:50.525527 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:04:50.526380 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:04:50.526380 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:04:50.526380 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:04:50.526380 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:04:50.526380 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:04:50.526380 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:04:50.526380 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:04:50.526380 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:04:50.526380 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:04:50.526380 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:04:50.526380 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:04:50.526380 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:04:50.526380 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:04:50.526380 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:04:50.526380 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:04:50.526380 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:04:50.527587 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:04:50.527587 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:04:50.527587 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:04:50.527587 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:04:50.527587 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:04:50.527587 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:04:50.527587 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:04:50.527587 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:04:50.527587 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:04:50.527587 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:04:50.527587 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 18 04:04:50.527587 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:04:50.527587 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 64/127] 10.222.0.20 () {56 vars in 1114 bytes} [Sat Jun 18 04:04:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:04:50.528522 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8eda12-006e-4d5f-9f5e-d5552cca1c10 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:50.576637 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b7c2fc-5d03-4a33-a7c0-d0bc464a5f45 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:50.611831 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2efd60-2e76-4cff-95d5-a5c8e27d3862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:50.613126 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2efd60-2e76-4cff-95d5-a5c8e27d3862 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:50.613632 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2efd60-2e76-4cff-95d5-a5c8e27d3862 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:50.614101 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2efd60-2e76-4cff-95d5-a5c8e27d3862 None admin] PATH_INFO: `/v3/users/7064955bb91f4385a8d5f4c522c8d511` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:50.615499 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2efd60-2e76-4cff-95d5-a5c8e27d3862 None admin] RBAC: Authorizing `identity:get_user(user_id=7064955bb91f4385a8d5f4c522c8d511)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:50.617186 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2efd60-2e76-4cff-95d5-a5c8e27d3862 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:50.619353 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 64/128] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Jun 18 04:04:50 2022] GET /identity/v3/users/7064955bb91f4385a8d5f4c522c8d511 => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:50.620507 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2efd60-2e76-4cff-95d5-a5c8e27d3862 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:50.718110 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:50.756612 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8eda12-006e-4d5f-9f5e-d5552cca1c10 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:50.793259 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeb50f7-6a1f-4d71-b827-807b7de178d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:50.794330 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb50f7-6a1f-4d71-b827-807b7de178d0 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:50.794986 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb50f7-6a1f-4d71-b827-807b7de178d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:50.795354 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb50f7-6a1f-4d71-b827-807b7de178d0 None admin] PATH_INFO: `/v3/users/732d81d4380b4131ac8b88c9215b9c7f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:50.796872 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeb50f7-6a1f-4d71-b827-807b7de178d0 None admin] RBAC: Authorizing `identity:get_user(user_id=732d81d4380b4131ac8b88c9215b9c7f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:50.798453 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeb50f7-6a1f-4d71-b827-807b7de178d0 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:50.800515 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 65/129] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Jun 18 04:04:50 2022] GET /identity/v3/users/732d81d4380b4131ac8b88c9215b9c7f => generated 275 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:50.801587 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeb50f7-6a1f-4d71-b827-807b7de178d0 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:50.802778 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2efd60-2e76-4cff-95d5-a5c8e27d3862 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:50.836629 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:50.865800 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d97eb-1be1-49ba-8eac-c34e95c8b578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:50.866408 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d97eb-1be1-49ba-8eac-c34e95c8b578 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:50.866697 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d97eb-1be1-49ba-8eac-c34e95c8b578 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:50.866974 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d97eb-1be1-49ba-8eac-c34e95c8b578 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:50.867747 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5d97eb-1be1-49ba-8eac-c34e95c8b578 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:04:50.868056 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5d97eb-1be1-49ba-8eac-c34e95c8b578 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:50.869547 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5d97eb-1be1-49ba-8eac-c34e95c8b578 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:50.884242 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 65/130] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Jun 18 04:04:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:50.885091 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d97eb-1be1-49ba-8eac-c34e95c8b578 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:50.988934 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeb50f7-6a1f-4d71-b827-807b7de178d0 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:51.020718 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d97eb-1be1-49ba-8eac-c34e95c8b578 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:51.054437 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d52c53-cf8d-4831-b10e-16286991ef6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:51.055519 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d52c53-cf8d-4831-b10e-16286991ef6c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:51.055806 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d52c53-cf8d-4831-b10e-16286991ef6c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:51.056082 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d52c53-cf8d-4831-b10e-16286991ef6c None admin] PATH_INFO: `/v3/projects/594195ae8d4c49c8babdbc7125c60372` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:51.056509 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a05242-0e64-4d42-9334-b889fbf65bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:51.057308 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d52c53-cf8d-4831-b10e-16286991ef6c None admin] RBAC: Authorizing `identity:get_project(project_id=594195ae8d4c49c8babdbc7125c60372)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:51.057621 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a05242-0e64-4d42-9334-b889fbf65bb2 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:51.058120 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a05242-0e64-4d42-9334-b889fbf65bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:51.058495 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a05242-0e64-4d42-9334-b889fbf65bb2 None admin] PATH_INFO: `/v3/projects/a709e1adfafe4068bb500cc3bec8353e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:51.058858 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d52c53-cf8d-4831-b10e-16286991ef6c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:51.059882 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a05242-0e64-4d42-9334-b889fbf65bb2 None admin] RBAC: Authorizing `identity:get_project(project_id=a709e1adfafe4068bb500cc3bec8353e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:51.060596 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 66/131] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Jun 18 04:04:50 2022] GET /identity/v3/projects/594195ae8d4c49c8babdbc7125c60372 => generated 298 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:51.061377 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d52c53-cf8d-4831-b10e-16286991ef6c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:51.061729 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a05242-0e64-4d42-9334-b889fbf65bb2 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:51.068665 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 66/132] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Jun 18 04:04:50 2022] GET /identity/v3/projects/a709e1adfafe4068bb500cc3bec8353e => generated 312 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:51.069684 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a05242-0e64-4d42-9334-b889fbf65bb2 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:51.090276 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:51.165108 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:51.175264 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d52c53-cf8d-4831-b10e-16286991ef6c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:51.190585 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a05242-0e64-4d42-9334-b889fbf65bb2 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:51.217869 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7cbd16-5dcf-4083-9459-9e0f39964554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:51.219007 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7cbd16-5dcf-4083-9459-9e0f39964554 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:51.219690 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7cbd16-5dcf-4083-9459-9e0f39964554 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:51.219975 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7cbd16-5dcf-4083-9459-9e0f39964554 None admin] PATH_INFO: `/v3/users/732d81d4380b4131ac8b88c9215b9c7f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:51.221504 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7cbd16-5dcf-4083-9459-9e0f39964554 None admin] RBAC: Authorizing `identity:get_user(user_id=732d81d4380b4131ac8b88c9215b9c7f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:51.223807 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7cbd16-5dcf-4083-9459-9e0f39964554 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:51.225794 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 67/133] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Jun 18 04:04:51 2022] GET /identity/v3/users/732d81d4380b4131ac8b88c9215b9c7f => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:51.226545 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7cbd16-5dcf-4083-9459-9e0f39964554 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:51.227613 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0bf709-6efd-4a61-86be-97794111a101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:51.228600 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0bf709-6efd-4a61-86be-97794111a101 None admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:51.228946 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0bf709-6efd-4a61-86be-97794111a101 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:51.229287 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0bf709-6efd-4a61-86be-97794111a101 None admin] PATH_INFO: `/v3/projects/594195ae8d4c49c8babdbc7125c60372/users/7064955bb91f4385a8d5f4c522c8d511/roles/d783a633c75847d48ef7ef5b169b0313` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:51.231878 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0bf709-6efd-4a61-86be-97794111a101 None admin] RBAC: Authorizing `identity:create_grant(project_id=594195ae8d4c49c8babdbc7125c60372, user_id=7064955bb91f4385a8d5f4c522c8d511, role_id=d783a633c75847d48ef7ef5b169b0313)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:51.233535 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0bf709-6efd-4a61-86be-97794111a101 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:51.252208 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 67/134] 10.222.0.20 () {58 vars in 1439 bytes} [Sat Jun 18 04:04:51 2022] PUT /identity/v3/projects/594195ae8d4c49c8babdbc7125c60372/users/7064955bb91f4385a8d5f4c522c8d511/roles/d783a633c75847d48ef7ef5b169b0313 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 04:04:51.254025 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c2b90-dfc9-4d09-adae-054c2e9a9420 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:51.254382 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c2b90-dfc9-4d09-adae-054c2e9a9420 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:51.254876 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c2b90-dfc9-4d09-adae-054c2e9a9420 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:51.257213 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 68/135] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:04:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:04:51.257945 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c2b90-dfc9-4d09-adae-054c2e9a9420 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:51.346144 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7cbd16-5dcf-4083-9459-9e0f39964554 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:51.351067 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:51.394586 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c71ebf-c34a-43fd-92c7-b9363c9d532c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:51.395746 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c71ebf-c34a-43fd-92c7-b9363c9d532c None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:51.396029 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c71ebf-c34a-43fd-92c7-b9363c9d532c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:51.396305 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c71ebf-c34a-43fd-92c7-b9363c9d532c None admin] PATH_INFO: `/v3/projects/a709e1adfafe4068bb500cc3bec8353e/users/732d81d4380b4131ac8b88c9215b9c7f/roles/d74f7ad64e584e6186564837fa3cf380` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:51.398250 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c2b90-dfc9-4d09-adae-054c2e9a9420 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:51.398437 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c71ebf-c34a-43fd-92c7-b9363c9d532c None admin] RBAC: Authorizing `identity:create_grant(project_id=a709e1adfafe4068bb500cc3bec8353e, user_id=732d81d4380b4131ac8b88c9215b9c7f, role_id=d74f7ad64e584e6186564837fa3cf380)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:51.400025 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c71ebf-c34a-43fd-92c7-b9363c9d532c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:51.421389 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 68/136] 10.222.0.20 () {58 vars in 1439 bytes} [Sat Jun 18 04:04:51 2022] PUT /identity/v3/projects/a709e1adfafe4068bb500cc3bec8353e/users/732d81d4380b4131ac8b88c9215b9c7f/roles/d74f7ad64e584e6186564837fa3cf380 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 04:04:51.423195 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a1353-f1e0-4540-9c17-0540643af290 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:51.423486 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a1353-f1e0-4540-9c17-0540643af290 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:51.424040 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a1353-f1e0-4540-9c17-0540643af290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:51.440180 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10820c9-9f1b-4ef8-ba6a-75443dfe8c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:51.441279 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10820c9-9f1b-4ef8-ba6a-75443dfe8c18 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:51.441565 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10820c9-9f1b-4ef8-ba6a-75443dfe8c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:51.441841 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10820c9-9f1b-4ef8-ba6a-75443dfe8c18 None admin] PATH_INFO: `/v3/projects/594195ae8d4c49c8babdbc7125c60372` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:51.443184 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10820c9-9f1b-4ef8-ba6a-75443dfe8c18 None admin] RBAC: Authorizing `identity:get_project(project_id=594195ae8d4c49c8babdbc7125c60372)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:51.445125 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10820c9-9f1b-4ef8-ba6a-75443dfe8c18 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:51.445414 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-318a1353-f1e0-4540-9c17-0540643af290 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:04:51.446653 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-318a1353-f1e0-4540-9c17-0540643af290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:04:51.447039 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 69/137] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Jun 18 04:04:51 2022] GET /identity/v3/projects/594195ae8d4c49c8babdbc7125c60372 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:51.453237 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10820c9-9f1b-4ef8-ba6a-75443dfe8c18 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:51.465703 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:51.549144 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 69/138] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:04:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:04:51.582184 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10820c9-9f1b-4ef8-ba6a-75443dfe8c18 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:51.587569 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a1353-f1e0-4540-9c17-0540643af290 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:51.624176 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd66e952-1ab0-49bd-bee4-ac702ea0d988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:51.625156 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66e952-1ab0-49bd-bee4-ac702ea0d988 None admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:51.625443 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66e952-1ab0-49bd-bee4-ac702ea0d988 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:51.625722 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66e952-1ab0-49bd-bee4-ac702ea0d988 None admin] PATH_INFO: `/v3/projects/594195ae8d4c49c8babdbc7125c60372/users/732d81d4380b4131ac8b88c9215b9c7f/roles/ba29217afc57483a90e90b287c480549` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:51.630817 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd66e952-1ab0-49bd-bee4-ac702ea0d988 None admin] RBAC: Authorizing `identity:create_grant(project_id=594195ae8d4c49c8babdbc7125c60372, user_id=732d81d4380b4131ac8b88c9215b9c7f, role_id=ba29217afc57483a90e90b287c480549)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:51.632328 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd66e952-1ab0-49bd-bee4-ac702ea0d988 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:51.635979 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:51.665141 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 70/139] 10.222.0.20 () {58 vars in 1439 bytes} [Sat Jun 18 04:04:51 2022] PUT /identity/v3/projects/594195ae8d4c49c8babdbc7125c60372/users/732d81d4380b4131ac8b88c9215b9c7f/roles/ba29217afc57483a90e90b287c480549 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 04:04:51.719893 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a1353-f1e0-4540-9c17-0540643af290 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:51.758961 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1107c54-809b-4904-b12e-544ba3e3fb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:51.759784 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1107c54-809b-4904-b12e-544ba3e3fb06 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:51.760061 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1107c54-809b-4904-b12e-544ba3e3fb06 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:51.760339 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1107c54-809b-4904-b12e-544ba3e3fb06 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:51.761658 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1107c54-809b-4904-b12e-544ba3e3fb06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:51.763233 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1107c54-809b-4904-b12e-544ba3e3fb06 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:51.764987 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 70/140] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:04:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:04:51.770744 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd66e952-1ab0-49bd-bee4-ac702ea0d988 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:51.917180 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd66e952-1ab0-49bd-bee4-ac702ea0d988 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:51.953305 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a6016-bdf0-4f6f-92e1-44722d4315c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:51.954569 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a6016-bdf0-4f6f-92e1-44722d4315c6 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:51.955025 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a6016-bdf0-4f6f-92e1-44722d4315c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:51.955460 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a6016-bdf0-4f6f-92e1-44722d4315c6 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:51.956340 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a6016-bdf0-4f6f-92e1-44722d4315c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:51.958035 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a6016-bdf0-4f6f-92e1-44722d4315c6 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:51.988077 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 71/141] 10.222.0.20 () {60 vars in 1132 bytes} [Sat Jun 18 04:04:51 2022] POST /identity/v3/users => generated 283 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 04:04:52.200341 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a45ef5-32c9-473b-bd86-026058d4b90e None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:52.200734 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a45ef5-32c9-473b-bd86-026058d4b90e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:52.200941 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a45ef5-32c9-473b-bd86-026058d4b90e None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:52.202474 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 71/142] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:04:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:04:52.207704 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafc4c6-082a-4b4a-883d-7be6c6e2f68c None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:52.207996 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafc4c6-082a-4b4a-883d-7be6c6e2f68c None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:52.208273 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafc4c6-082a-4b4a-883d-7be6c6e2f68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:52.230270 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-5bafc4c6-082a-4b4a-883d-7be6c6e2f68c None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:04:52.231477 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5bafc4c6-082a-4b4a-883d-7be6c6e2f68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:04:52.301993 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:52.318768 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0e0d4-6113-4ee6-9018-7478a8352743 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:52.319072 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0e0d4-6113-4ee6-9018-7478a8352743 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:52.319322 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0e0d4-6113-4ee6-9018-7478a8352743 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:52.320988 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 72/143] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:04:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:04:52.326593 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b11fd4-6ef5-403c-b099-6257bcc0036b None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:52.327021 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b11fd4-6ef5-403c-b099-6257bcc0036b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:52.327436 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b11fd4-6ef5-403c-b099-6257bcc0036b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:52.330812 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 72/144] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:04:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:04:52.345977 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-64b11fd4-6ef5-403c-b099-6257bcc0036b None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:04:52.347160 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-64b11fd4-6ef5-403c-b099-6257bcc0036b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:04:52.358872 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:52.375605 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafc4c6-082a-4b4a-883d-7be6c6e2f68c None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:52.475987 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 73/145] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:04:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 18 04:04:52.514914 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b11fd4-6ef5-403c-b099-6257bcc0036b None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:52.541650 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafc4c6-082a-4b4a-883d-7be6c6e2f68c None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:52.585209 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d74588-08f8-45e7-bcac-0a26f70cf9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:52.586006 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d74588-08f8-45e7-bcac-0a26f70cf9ce None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:52.586285 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d74588-08f8-45e7-bcac-0a26f70cf9ce None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:52.586550 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d74588-08f8-45e7-bcac-0a26f70cf9ce None admin] PATH_INFO: `/v3/roles/member` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:52.606388 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d74588-08f8-45e7-bcac-0a26f70cf9ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:04:52.615882 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-86d74588-08f8-45e7-bcac-0a26f70cf9ce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 18 04:04:52.615882 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:04:52.615882 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:04:52.615882 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:04:52.615882 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:04:52.615882 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:04:52.615882 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:04:52.615882 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:04:52.615882 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:04:52.615882 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:04:52.615882 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:04:52.615882 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:04:52.615882 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:04:52.615882 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:04:52.615882 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:04:52.615882 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:04:52.616750 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:04:52.616750 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:04:52.616750 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:04:52.616750 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:04:52.616750 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:04:52.616750 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:04:52.616750 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:04:52.616750 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:04:52.616750 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:04:52.616750 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:04:52.616750 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:04:52.616750 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:04:52.616750 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:04:52.616750 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:04:52.616750 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:04:52.616750 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:04:52.617499 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:04:52.617499 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:04:52.617499 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:04:52.617499 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:04:52.617499 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:04:52.617499 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:04:52.617499 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:04:52.617499 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:04:52.617499 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:04:52.617499 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:04:52.617499 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 18 04:04:52.617499 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:04:52.618729 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 73/146] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Jun 18 04:04:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:04:52.627061 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d74588-08f8-45e7-bcac-0a26f70cf9ce None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:52.682542 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b11fd4-6ef5-403c-b099-6257bcc0036b None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:52.724713 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aeffdc-d65e-4faf-8102-cbc5acb4b195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:52.725533 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aeffdc-d65e-4faf-8102-cbc5acb4b195 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:52.726082 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aeffdc-d65e-4faf-8102-cbc5acb4b195 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:52.726436 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aeffdc-d65e-4faf-8102-cbc5acb4b195 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:52.740026 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aeffdc-d65e-4faf-8102-cbc5acb4b195 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:04:52.749462 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-a6aeffdc-d65e-4faf-8102-cbc5acb4b195 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 18 04:04:52.749462 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:04:52.749462 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:04:52.749462 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:04:52.749462 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:04:52.749462 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:04:52.749462 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:04:52.749462 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:04:52.749462 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:04:52.749462 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:04:52.749462 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:04:52.749462 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:04:52.749462 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:04:52.749462 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:04:52.749462 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:04:52.749462 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:04:52.750362 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:04:52.750362 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:04:52.750362 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:04:52.750362 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:04:52.750362 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:04:52.750362 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:04:52.750362 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:04:52.750362 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:04:52.750362 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:04:52.750362 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:04:52.750362 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:04:52.750362 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:04:52.750362 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:04:52.750362 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:04:52.750362 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:04:52.750362 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:04:52.751100 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:04:52.751100 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:04:52.751100 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:04:52.751100 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:04:52.751100 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:04:52.751100 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:04:52.751100 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:04:52.751100 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:04:52.751100 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:04:52.751100 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:04:52.751100 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 18 04:04:52.751100 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:04:52.751100 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 74/147] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Jun 18 04:04:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 04:04:52.759364 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aeffdc-d65e-4faf-8102-cbc5acb4b195 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:52.764231 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:52.785853 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:52.842597 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d74588-08f8-45e7-bcac-0a26f70cf9ce None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:52.880103 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696bd12-5089-4a66-9ce6-d9c8cd3481a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:52.880908 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696bd12-5089-4a66-9ce6-d9c8cd3481a5 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:52.881265 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696bd12-5089-4a66-9ce6-d9c8cd3481a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:52.881614 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696bd12-5089-4a66-9ce6-d9c8cd3481a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:52.882507 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c696bd12-5089-4a66-9ce6-d9c8cd3481a5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:04:52.882818 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c696bd12-5089-4a66-9ce6-d9c8cd3481a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:52.884256 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c696bd12-5089-4a66-9ce6-d9c8cd3481a5 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:52.894021 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 74/148] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Jun 18 04:04:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:52.899606 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696bd12-5089-4a66-9ce6-d9c8cd3481a5 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:52.917676 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aeffdc-d65e-4faf-8102-cbc5acb4b195 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:52.968303 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f62cf-ed26-4113-8e42-1d8c7e51535c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:52.969027 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f62cf-ed26-4113-8e42-1d8c7e51535c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:52.969324 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f62cf-ed26-4113-8e42-1d8c7e51535c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:52.969599 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f62cf-ed26-4113-8e42-1d8c7e51535c None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:52.970721 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37f62cf-ed26-4113-8e42-1d8c7e51535c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:04:52.970721 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37f62cf-ed26-4113-8e42-1d8c7e51535c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:52.976617 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37f62cf-ed26-4113-8e42-1d8c7e51535c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:52.985739 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 75/149] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Jun 18 04:04:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:52.993599 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f62cf-ed26-4113-8e42-1d8c7e51535c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:53.010504 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696bd12-5089-4a66-9ce6-d9c8cd3481a5 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:53.019866 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:53.050215 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe91446-28af-45ba-863b-d26e0901c6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:53.051166 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe91446-28af-45ba-863b-d26e0901c6f1 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:53.051454 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe91446-28af-45ba-863b-d26e0901c6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:53.051731 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe91446-28af-45ba-863b-d26e0901c6f1 None admin] PATH_INFO: `/v3/users/732d81d4380b4131ac8b88c9215b9c7f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:53.053038 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe91446-28af-45ba-863b-d26e0901c6f1 None admin] RBAC: Authorizing `identity:get_user(user_id=732d81d4380b4131ac8b88c9215b9c7f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:53.054757 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe91446-28af-45ba-863b-d26e0901c6f1 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:53.060828 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 75/150] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Jun 18 04:04:52 2022] GET /identity/v3/users/732d81d4380b4131ac8b88c9215b9c7f => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:04:53.063074 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe91446-28af-45ba-863b-d26e0901c6f1 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:53.173095 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:53.225919 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe91446-28af-45ba-863b-d26e0901c6f1 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:53.243253 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f62cf-ed26-4113-8e42-1d8c7e51535c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:53.290284 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3bb925-0a35-49f6-b4a0-907c54bfc4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:53.291185 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3bb925-0a35-49f6-b4a0-907c54bfc4ec None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:53.291731 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3bb925-0a35-49f6-b4a0-907c54bfc4ec None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:53.292046 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3bb925-0a35-49f6-b4a0-907c54bfc4ec None admin] PATH_INFO: `/v3/users/adb92e9a455f4a6498d4e82112f55eb9` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:53.296649 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3bb925-0a35-49f6-b4a0-907c54bfc4ec None admin] RBAC: Authorizing `identity:get_user(user_id=adb92e9a455f4a6498d4e82112f55eb9)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:53.298136 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3bb925-0a35-49f6-b4a0-907c54bfc4ec None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:53.299494 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad5849-d496-47c1-99d2-8d41bff8aeee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:53.299844 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 76/151] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Jun 18 04:04:52 2022] GET /identity/v3/users/adb92e9a455f4a6498d4e82112f55eb9 => generated 289 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:53.300668 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad5849-d496-47c1-99d2-8d41bff8aeee None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:53.301187 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad5849-d496-47c1-99d2-8d41bff8aeee None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:53.301641 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad5849-d496-47c1-99d2-8d41bff8aeee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:53.305359 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3bb925-0a35-49f6-b4a0-907c54bfc4ec None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:53.367111 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:53.430446 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3bb925-0a35-49f6-b4a0-907c54bfc4ec None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:53.446415 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ad5849-d496-47c1-99d2-8d41bff8aeee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:53.448297 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ad5849-d496-47c1-99d2-8d41bff8aeee None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:53.469812 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aed399-282e-4d39-a0d8-871df231f961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:53.471206 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aed399-282e-4d39-a0d8-871df231f961 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:53.471492 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aed399-282e-4d39-a0d8-871df231f961 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:53.471768 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aed399-282e-4d39-a0d8-871df231f961 None admin] PATH_INFO: `/v3/projects/594195ae8d4c49c8babdbc7125c60372` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:53.473426 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aed399-282e-4d39-a0d8-871df231f961 None admin] RBAC: Authorizing `identity:get_project(project_id=594195ae8d4c49c8babdbc7125c60372)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:53.475156 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aed399-282e-4d39-a0d8-871df231f961 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:53.477134 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 77/152] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Jun 18 04:04:53 2022] GET /identity/v3/projects/594195ae8d4c49c8babdbc7125c60372 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:04:53.483675 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aed399-282e-4d39-a0d8-871df231f961 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:53.489123 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:53.607257 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aed399-282e-4d39-a0d8-871df231f961 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:53.625100 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 76/153] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Jun 18 04:04:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 18 04:04:53.646400 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad5849-d496-47c1-99d2-8d41bff8aeee None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:53.652605 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a97970-6eb7-43d3-bbb0-893eabdaf1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:53.652605 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a97970-6eb7-43d3-bbb0-893eabdaf1a1 None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:53.652605 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a97970-6eb7-43d3-bbb0-893eabdaf1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:53.652605 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a97970-6eb7-43d3-bbb0-893eabdaf1a1 None admin] PATH_INFO: `/v3/projects/594195ae8d4c49c8babdbc7125c60372/users/adb92e9a455f4a6498d4e82112f55eb9/roles/3af5984773ef41448b3d4ef5e617e090` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:53.653493 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a97970-6eb7-43d3-bbb0-893eabdaf1a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=594195ae8d4c49c8babdbc7125c60372, user_id=adb92e9a455f4a6498d4e82112f55eb9, role_id=3af5984773ef41448b3d4ef5e617e090)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:53.655915 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a97970-6eb7-43d3-bbb0-893eabdaf1a1 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:53.681976 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 78/154] 10.222.0.20 () {58 vars in 1439 bytes} [Sat Jun 18 04:04:53 2022] PUT /identity/v3/projects/594195ae8d4c49c8babdbc7125c60372/users/adb92e9a455f4a6498d4e82112f55eb9/roles/3af5984773ef41448b3d4ef5e617e090 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 04:04:53.744676 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:53.778103 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad5849-d496-47c1-99d2-8d41bff8aeee None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:53.820047 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed0a4f-ed60-4b70-9dc6-b81948a1990a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:53.821078 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed0a4f-ed60-4b70-9dc6-b81948a1990a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:53.821352 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed0a4f-ed60-4b70-9dc6-b81948a1990a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:53.821617 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed0a4f-ed60-4b70-9dc6-b81948a1990a None admin] PATH_INFO: `/v3/projects/594195ae8d4c49c8babdbc7125c60372` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:53.825539 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed0a4f-ed60-4b70-9dc6-b81948a1990a None admin] RBAC: Authorizing `identity:get_project(project_id=594195ae8d4c49c8babdbc7125c60372)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:53.827083 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed0a4f-ed60-4b70-9dc6-b81948a1990a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:53.829371 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 77/155] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Jun 18 04:04:53 2022] GET /identity/v3/projects/594195ae8d4c49c8babdbc7125c60372 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:04:53.835290 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a97970-6eb7-43d3-bbb0-893eabdaf1a1 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:53.953494 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:54.039009 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a97970-6eb7-43d3-bbb0-893eabdaf1a1 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:54.091174 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108b22f-e3b7-4877-8e8d-38478dc45b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:54.091849 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108b22f-e3b7-4877-8e8d-38478dc45b4d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:54.092129 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108b22f-e3b7-4877-8e8d-38478dc45b4d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:54.092401 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108b22f-e3b7-4877-8e8d-38478dc45b4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:54.093277 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f108b22f-e3b7-4877-8e8d-38478dc45b4d None admin] RBAC: Adding query filter params (role.id=d74f7ad64e584e6186564837fa3cf380, scope.project.id=594195ae8d4c49c8babdbc7125c60372, user.id=732d81d4380b4131ac8b88c9215b9c7f) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:04:54.093584 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f108b22f-e3b7-4877-8e8d-38478dc45b4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:54.095049 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f108b22f-e3b7-4877-8e8d-38478dc45b4d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:54.105556 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 79/156] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Jun 18 04:04:53 2022] GET /identity/v3/role_assignments?user.id=732d81d4380b4131ac8b88c9215b9c7f&scope.project.id=594195ae8d4c49c8babdbc7125c60372&role.id=d74f7ad64e584e6186564837fa3cf380 => generated 608 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:54.308640 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f80f5b-2965-46ab-a76d-2e0991ce08fb None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:54.308830 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f80f5b-2965-46ab-a76d-2e0991ce08fb None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:54.309103 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f80f5b-2965-46ab-a76d-2e0991ce08fb None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:54.310663 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 78/157] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:04:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:04:54.316148 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0d743-e7ca-4506-9a61-30e259972f86 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:54.316433 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0d743-e7ca-4506-9a61-30e259972f86 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:54.316727 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0d743-e7ca-4506-9a61-30e259972f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:54.341648 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-11d0d743-e7ca-4506-9a61-30e259972f86 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:04:54.342857 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-11d0d743-e7ca-4506-9a61-30e259972f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:04:54.421261 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 80/158] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:04:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:04:54.459789 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f80f5b-2965-46ab-a76d-2e0991ce08fb None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:54.588253 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f80f5b-2965-46ab-a76d-2e0991ce08fb None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:54.636252 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd30f1-9122-4bac-855d-2e61a9b5bd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:54.637897 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd30f1-9122-4bac-855d-2e61a9b5bd03 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:54.638403 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd30f1-9122-4bac-855d-2e61a9b5bd03 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:54.638895 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd30f1-9122-4bac-855d-2e61a9b5bd03 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:54.651192 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:54.655036 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfd30f1-9122-4bac-855d-2e61a9b5bd03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:04:54.663323 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-4dfd30f1-9122-4bac-855d-2e61a9b5bd03 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 04:04:54.663323 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:04:54.663323 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:04:54.663323 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:04:54.663323 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:04:54.663323 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:04:54.663323 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:04:54.663323 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:04:54.663323 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:04:54.663323 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:04:54.663323 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:04:54.663323 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:04:54.663323 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:04:54.663323 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:04:54.663323 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:04:54.663323 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:04:54.664279 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:04:54.664279 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:04:54.664279 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:04:54.664279 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:04:54.664279 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:04:54.664279 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:04:54.664279 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:04:54.664279 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:04:54.664279 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:04:54.664279 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:04:54.664279 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:04:54.664279 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:04:54.664279 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:04:54.664279 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:04:54.664279 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:04:54.664279 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:04:54.668010 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:04:54.668010 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:04:54.668010 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:04:54.668010 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:04:54.668010 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:04:54.668010 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:04:54.668010 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:04:54.668010 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:04:54.668010 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:04:54.668010 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:04:54.668010 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 04:04:54.668010 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:04:54.670317 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 79/159] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Jun 18 04:04:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:04:54.677717 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d0d743-e7ca-4506-9a61-30e259972f86 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:54.781806 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:54.832770 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d0d743-e7ca-4506-9a61-30e259972f86 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:54.880146 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26141a41-2ad4-4b25-89bc-0310dc1e0f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:54.881520 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26141a41-2ad4-4b25-89bc-0310dc1e0f41 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:54.881940 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26141a41-2ad4-4b25-89bc-0310dc1e0f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:54.882353 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26141a41-2ad4-4b25-89bc-0310dc1e0f41 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:54.883319 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26141a41-2ad4-4b25-89bc-0310dc1e0f41 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:04:54.883762 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26141a41-2ad4-4b25-89bc-0310dc1e0f41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:54.885408 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26141a41-2ad4-4b25-89bc-0310dc1e0f41 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:54.894616 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 81/160] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Jun 18 04:04:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:54.900710 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd30f1-9122-4bac-855d-2e61a9b5bd03 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:55.044772 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd30f1-9122-4bac-855d-2e61a9b5bd03 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:55.047402 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd143c4-cb9f-43ea-8870-526a4db87074 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:55.047914 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd143c4-cb9f-43ea-8870-526a4db87074 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:55.048383 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd143c4-cb9f-43ea-8870-526a4db87074 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:55.050305 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 82/161] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:04:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:04:55.057012 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba017a1b-b83e-4d49-bfab-67527e00742b None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:55.058055 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba017a1b-b83e-4d49-bfab-67527e00742b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:55.058534 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba017a1b-b83e-4d49-bfab-67527e00742b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:55.086968 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-ba017a1b-b83e-4d49-bfab-67527e00742b None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:04:55.087169 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ba017a1b-b83e-4d49-bfab-67527e00742b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:04:55.091519 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aeca0f-5695-4716-bf8c-a8c2070fde27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:55.092469 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aeca0f-5695-4716-bf8c-a8c2070fde27 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:55.092780 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aeca0f-5695-4716-bf8c-a8c2070fde27 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:55.093045 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aeca0f-5695-4716-bf8c-a8c2070fde27 None admin] PATH_INFO: `/v3/users/7064955bb91f4385a8d5f4c522c8d511` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:55.094947 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aeca0f-5695-4716-bf8c-a8c2070fde27 None admin] RBAC: Authorizing `identity:get_user(user_id=7064955bb91f4385a8d5f4c522c8d511)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:55.096808 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aeca0f-5695-4716-bf8c-a8c2070fde27 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:55.100745 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 80/162] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Jun 18 04:04:54 2022] GET /identity/v3/users/7064955bb91f4385a8d5f4c522c8d511 => generated 247 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:55.108827 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aeca0f-5695-4716-bf8c-a8c2070fde27 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:55.224694 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 83/163] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:04:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 18 04:04:55.234365 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:55.265168 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba017a1b-b83e-4d49-bfab-67527e00742b None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:55.287138 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aeca0f-5695-4716-bf8c-a8c2070fde27 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:55.358869 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe27701-731e-495b-98dc-3198947ccd7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:55.359887 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe27701-731e-495b-98dc-3198947ccd7a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:55.360163 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe27701-731e-495b-98dc-3198947ccd7a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:55.360430 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe27701-731e-495b-98dc-3198947ccd7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:55.360932 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:55.434953 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe27701-731e-495b-98dc-3198947ccd7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:55.436460 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe27701-731e-495b-98dc-3198947ccd7a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:55.458406 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba017a1b-b83e-4d49-bfab-67527e00742b None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:55.535581 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcc12b1-22a4-4c13-b196-656e19acdf2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:55.536316 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc12b1-22a4-4c13-b196-656e19acdf2f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:55.536611 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc12b1-22a4-4c13-b196-656e19acdf2f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:55.536877 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc12b1-22a4-4c13-b196-656e19acdf2f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:55.556323 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:55.565285 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcc12b1-22a4-4c13-b196-656e19acdf2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:04:55.588410 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-1dcc12b1-22a4-4c13-b196-656e19acdf2f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 18 04:04:55.588410 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:04:55.588410 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:04:55.588410 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:04:55.588410 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:04:55.588410 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:04:55.588410 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:04:55.588410 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:04:55.588410 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:04:55.588410 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:04:55.588410 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:04:55.588410 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:04:55.588410 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:04:55.588410 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:04:55.588410 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:04:55.588410 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:04:55.589410 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:04:55.589410 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:04:55.589410 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:04:55.589410 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:04:55.589410 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:04:55.589410 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:04:55.589410 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:04:55.589410 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:04:55.589410 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:04:55.589410 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:04:55.589410 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:04:55.589410 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:04:55.589410 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:04:55.589410 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:04:55.589410 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:04:55.589410 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:04:55.590177 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:04:55.590177 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:04:55.590177 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:04:55.590177 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:04:55.590177 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:04:55.590177 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:04:55.590177 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:04:55.590177 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:04:55.590177 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:04:55.590177 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:04:55.590177 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 18 04:04:55.590177 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:04:55.590177 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 84/164] 10.222.0.20 () {56 vars in 1114 bytes} [Sat Jun 18 04:04:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:04:55.594492 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab98414f-79fe-42c7-b9de-177b65827233 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:55.594770 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab98414f-79fe-42c7-b9de-177b65827233 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:55.595040 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab98414f-79fe-42c7-b9de-177b65827233 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:55.598894 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 85/165] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:04:55 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:04:55.600560 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab98414f-79fe-42c7-b9de-177b65827233 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:55.637279 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 81/166] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Jun 18 04:04:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 04:04:55.638663 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1fe93-5d19-4880-9141-d5e47143cbb1 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:55.638949 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1fe93-5d19-4880-9141-d5e47143cbb1 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:55.639218 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1fe93-5d19-4880-9141-d5e47143cbb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:55.673779 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-dbe1fe93-5d19-4880-9141-d5e47143cbb1 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:04:55.674958 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-dbe1fe93-5d19-4880-9141-d5e47143cbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:04:55.756382 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab98414f-79fe-42c7-b9de-177b65827233 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:55.769019 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:55.810247 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac705df-ea9b-43d5-9aed-a2ca097cfcc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:55.810843 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac705df-ea9b-43d5-9aed-a2ca097cfcc1 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:55.811123 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac705df-ea9b-43d5-9aed-a2ca097cfcc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:55.811396 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac705df-ea9b-43d5-9aed-a2ca097cfcc1 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:55.812762 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac705df-ea9b-43d5-9aed-a2ca097cfcc1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:04:55.813174 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac705df-ea9b-43d5-9aed-a2ca097cfcc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:55.814684 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac705df-ea9b-43d5-9aed-a2ca097cfcc1 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:55.822122 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 82/167] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:04:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:04:55.823417 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe1fe93-5d19-4880-9141-d5e47143cbb1 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:55.833024 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 86/168] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Jun 18 04:04:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:55.838626 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac705df-ea9b-43d5-9aed-a2ca097cfcc1 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:55.966388 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac705df-ea9b-43d5-9aed-a2ca097cfcc1 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:56.008637 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:56.013359 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe1fe93-5d19-4880-9141-d5e47143cbb1 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:56.038228 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3cab80-b9f5-440a-9f21-4f736018db3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:56.039122 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3cab80-b9f5-440a-9f21-4f736018db3c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:56.039391 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3cab80-b9f5-440a-9f21-4f736018db3c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:56.039658 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3cab80-b9f5-440a-9f21-4f736018db3c None admin] PATH_INFO: `/v3/users/732d81d4380b4131ac8b88c9215b9c7f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:56.042129 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3cab80-b9f5-440a-9f21-4f736018db3c None admin] RBAC: Authorizing `identity:get_user(user_id=732d81d4380b4131ac8b88c9215b9c7f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:56.043586 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3cab80-b9f5-440a-9f21-4f736018db3c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:56.045285 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 87/169] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Jun 18 04:04:55 2022] GET /identity/v3/users/732d81d4380b4131ac8b88c9215b9c7f => generated 275 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:04:56.046936 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3cab80-b9f5-440a-9f21-4f736018db3c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:56.100989 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8110cf2-f15f-4414-a6a3-eba3757da693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:56.101786 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8110cf2-f15f-4414-a6a3-eba3757da693 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:56.102059 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8110cf2-f15f-4414-a6a3-eba3757da693 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:56.102326 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8110cf2-f15f-4414-a6a3-eba3757da693 None admin] PATH_INFO: `/v3/projects/594195ae8d4c49c8babdbc7125c60372` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:56.103678 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8110cf2-f15f-4414-a6a3-eba3757da693 None admin] RBAC: Authorizing `identity:get_project(project_id=594195ae8d4c49c8babdbc7125c60372)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:56.105228 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8110cf2-f15f-4414-a6a3-eba3757da693 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:56.106949 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 83/170] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Jun 18 04:04:55 2022] GET /identity/v3/projects/594195ae8d4c49c8babdbc7125c60372 => generated 298 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:56.120542 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8110cf2-f15f-4414-a6a3-eba3757da693 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:56.154713 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:56.269032 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8110cf2-f15f-4414-a6a3-eba3757da693 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:56.281122 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3cab80-b9f5-440a-9f21-4f736018db3c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:56.305544 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051df5e4-1787-4de1-be74-87176a093c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:56.306564 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051df5e4-1787-4de1-be74-87176a093c84 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:56.307034 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051df5e4-1787-4de1-be74-87176a093c84 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:56.307527 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051df5e4-1787-4de1-be74-87176a093c84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:56.342873 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:56.365724 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aefb30e-22a8-45bf-9420-dc8b97e907c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:56.366181 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefb30e-22a8-45bf-9420-dc8b97e907c5 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:56.366456 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefb30e-22a8-45bf-9420-dc8b97e907c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:56.366723 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefb30e-22a8-45bf-9420-dc8b97e907c5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:56.383180 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051df5e4-1787-4de1-be74-87176a093c84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:56.385050 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051df5e4-1787-4de1-be74-87176a093c84 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:56.398924 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aefb30e-22a8-45bf-9420-dc8b97e907c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:04:56.406912 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-1aefb30e-22a8-45bf-9420-dc8b97e907c5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 18 04:04:56.406912 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:04:56.406912 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:04:56.406912 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:04:56.406912 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:04:56.406912 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:04:56.406912 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:04:56.406912 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:04:56.406912 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:04:56.406912 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:04:56.406912 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:04:56.406912 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:04:56.406912 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:04:56.406912 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:04:56.406912 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:04:56.406912 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:04:56.407816 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:04:56.407816 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:04:56.407816 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:04:56.407816 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:04:56.407816 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:04:56.407816 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:04:56.407816 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:04:56.407816 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:04:56.407816 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:04:56.407816 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:04:56.407816 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:04:56.407816 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:04:56.407816 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:04:56.407816 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:04:56.407816 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:04:56.407816 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:04:56.408697 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:04:56.408697 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:04:56.408697 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:04:56.408697 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:04:56.408697 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:04:56.408697 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:04:56.408697 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:04:56.408697 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:04:56.408697 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:04:56.408697 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:04:56.408697 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 18 04:04:56.408697 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:04:56.413035 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 88/171] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Jun 18 04:04:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:04:56.413916 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aefb30e-22a8-45bf-9420-dc8b97e907c5 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:56.494067 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 84/172] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Jun 18 04:04:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 04:04:56.495315 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051df5e4-1787-4de1-be74-87176a093c84 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:56.562645 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:56.601220 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051df5e4-1787-4de1-be74-87176a093c84 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:56.638221 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af39998-643b-40a5-b7da-50deeccc7c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:56.639674 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af39998-643b-40a5-b7da-50deeccc7c45 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:56.640158 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af39998-643b-40a5-b7da-50deeccc7c45 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:56.640654 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af39998-643b-40a5-b7da-50deeccc7c45 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:56.641610 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af39998-643b-40a5-b7da-50deeccc7c45 None admin] RBAC: Adding query filter params (name=member) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:04:56.642101 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af39998-643b-40a5-b7da-50deeccc7c45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:56.643667 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af39998-643b-40a5-b7da-50deeccc7c45 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:56.652929 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 85/173] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Jun 18 04:04:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:56.653951 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af39998-643b-40a5-b7da-50deeccc7c45 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:56.669666 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aefb30e-22a8-45bf-9420-dc8b97e907c5 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:56.676948 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:56.737330 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706dc580-bd18-4352-96e7-be5c6dab5806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:56.738036 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706dc580-bd18-4352-96e7-be5c6dab5806 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:56.738316 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706dc580-bd18-4352-96e7-be5c6dab5806 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:56.738588 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706dc580-bd18-4352-96e7-be5c6dab5806 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:56.739441 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706dc580-bd18-4352-96e7-be5c6dab5806 None admin] RBAC: Adding query filter params (role.id=d783a633c75847d48ef7ef5b169b0313, scope.project.id=594195ae8d4c49c8babdbc7125c60372, user.id=7064955bb91f4385a8d5f4c522c8d511) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:04:56.739749 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706dc580-bd18-4352-96e7-be5c6dab5806 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:56.741229 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706dc580-bd18-4352-96e7-be5c6dab5806 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:56.747996 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 89/174] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Jun 18 04:04:56 2022] GET /identity/v3/role_assignments?user.id=7064955bb91f4385a8d5f4c522c8d511&scope.project.id=594195ae8d4c49c8babdbc7125c60372&role.id=d783a633c75847d48ef7ef5b169b0313 => generated 608 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:56.753934 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3150969-08e4-4e17-9cf0-b7d1e04b3241 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:56.754432 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3150969-08e4-4e17-9cf0-b7d1e04b3241 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:56.754908 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3150969-08e4-4e17-9cf0-b7d1e04b3241 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:56.756852 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 90/175] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:04:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:04:56.757924 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3150969-08e4-4e17-9cf0-b7d1e04b3241 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:56.763472 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af39998-643b-40a5-b7da-50deeccc7c45 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:56.793686 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:56.803261 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c55776a-2f97-4edc-8ab8-095252928e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:56.804537 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55776a-2f97-4edc-8ab8-095252928e69 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:56.805068 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55776a-2f97-4edc-8ab8-095252928e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:56.805608 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55776a-2f97-4edc-8ab8-095252928e69 None admin] PATH_INFO: `/v3/projects/594195ae8d4c49c8babdbc7125c60372` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:56.807060 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c55776a-2f97-4edc-8ab8-095252928e69 None admin] RBAC: Authorizing `identity:get_project(project_id=594195ae8d4c49c8babdbc7125c60372)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:56.809774 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c55776a-2f97-4edc-8ab8-095252928e69 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:56.811962 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 86/176] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Jun 18 04:04:56 2022] GET /identity/v3/projects/594195ae8d4c49c8babdbc7125c60372 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:56.813637 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844f1b4-39e9-456d-ae00-ed9347a036f1 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:56.814139 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844f1b4-39e9-456d-ae00-ed9347a036f1 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:56.814601 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844f1b4-39e9-456d-ae00-ed9347a036f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:56.833701 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-f844f1b4-39e9-456d-ae00-ed9347a036f1 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:04:56.835275 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-f844f1b4-39e9-456d-ae00-ed9347a036f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:04:56.910994 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 87/177] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:04:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:04:56.912212 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f844f1b4-39e9-456d-ae00-ed9347a036f1 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:57.011741 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3150969-08e4-4e17-9cf0-b7d1e04b3241 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:57.037689 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f844f1b4-39e9-456d-ae00-ed9347a036f1 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:57.052491 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd1d379-39df-497b-ab7c-96445e1a5926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:57.053420 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd1d379-39df-497b-ab7c-96445e1a5926 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:57.053696 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd1d379-39df-497b-ab7c-96445e1a5926 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:57.053964 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd1d379-39df-497b-ab7c-96445e1a5926 None admin] PATH_INFO: `/v3/users/732d81d4380b4131ac8b88c9215b9c7f` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:57.055200 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd1d379-39df-497b-ab7c-96445e1a5926 None admin] RBAC: Authorizing `identity:get_user(user_id=732d81d4380b4131ac8b88c9215b9c7f)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:57.056607 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd1d379-39df-497b-ab7c-96445e1a5926 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:57.058409 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 91/178] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Jun 18 04:04:56 2022] GET /identity/v3/users/732d81d4380b4131ac8b88c9215b9c7f => generated 275 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:57.059380 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd1d379-39df-497b-ab7c-96445e1a5926 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:57.068709 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:57.078842 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f339aea2-6e3f-4eaf-8b4f-2ac22e850480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:57.079850 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339aea2-6e3f-4eaf-8b4f-2ac22e850480 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:57.080345 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339aea2-6e3f-4eaf-8b4f-2ac22e850480 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:57.080852 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339aea2-6e3f-4eaf-8b4f-2ac22e850480 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:57.081933 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f339aea2-6e3f-4eaf-8b4f-2ac22e850480 None admin] RBAC: Adding query filter params (role.id=ba29217afc57483a90e90b287c480549, scope.project.id=594195ae8d4c49c8babdbc7125c60372, user.id=732d81d4380b4131ac8b88c9215b9c7f) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:04:57.082436 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f339aea2-6e3f-4eaf-8b4f-2ac22e850480 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:57.084146 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f339aea2-6e3f-4eaf-8b4f-2ac22e850480 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:57.091041 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 88/179] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Jun 18 04:04:56 2022] GET /identity/v3/role_assignments?user.id=732d81d4380b4131ac8b88c9215b9c7f&scope.project.id=594195ae8d4c49c8babdbc7125c60372&role.id=ba29217afc57483a90e90b287c480549 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:57.092606 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873cb1ce-a06d-4fd0-8668-f0975db4cae9 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:57.093382 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873cb1ce-a06d-4fd0-8668-f0975db4cae9 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:57.093382 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873cb1ce-a06d-4fd0-8668-f0975db4cae9 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:57.094549 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 89/180] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:04:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:04:57.095150 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873cb1ce-a06d-4fd0-8668-f0975db4cae9 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:57.103320 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:57.196452 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd1d379-39df-497b-ab7c-96445e1a5926 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:57.233623 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873cb1ce-a06d-4fd0-8668-f0975db4cae9 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:57.234956 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce43585-07ae-4cdb-bee4-b62eade98d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:57.235791 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce43585-07ae-4cdb-bee4-b62eade98d19 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:57.236070 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce43585-07ae-4cdb-bee4-b62eade98d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:57.236341 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce43585-07ae-4cdb-bee4-b62eade98d19 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:57.248961 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce43585-07ae-4cdb-bee4-b62eade98d19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:04:57.257511 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-cce43585-07ae-4cdb-bee4-b62eade98d19 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 18 04:04:57.257511 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:04:57.257511 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:04:57.257511 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:04:57.257511 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:04:57.257511 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:04:57.257511 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:04:57.257511 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:04:57.257511 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:04:57.257511 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:04:57.257511 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:04:57.257511 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:04:57.257511 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:04:57.257511 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:04:57.257511 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:04:57.257511 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:04:57.258469 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:04:57.258469 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:04:57.258469 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:04:57.258469 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:04:57.258469 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:04:57.258469 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:04:57.258469 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:04:57.258469 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:04:57.258469 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:04:57.258469 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:04:57.258469 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:04:57.258469 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:04:57.258469 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:04:57.258469 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:04:57.258469 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:04:57.258469 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:04:57.259246 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:04:57.259246 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:04:57.259246 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:04:57.259246 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:04:57.259246 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:04:57.259246 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:04:57.259246 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:04:57.259246 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:04:57.259246 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:04:57.259246 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:04:57.259246 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 18 04:04:57.259246 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:04:57.259246 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 92/181] 10.222.0.20 () {56 vars in 1114 bytes} [Sat Jun 18 04:04:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:04:57.260384 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16008a37-f63a-4acc-97e6-7ba616d5257b None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:57.260479 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16008a37-f63a-4acc-97e6-7ba616d5257b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:57.260844 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16008a37-f63a-4acc-97e6-7ba616d5257b None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:57.262776 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 93/182] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:04:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:04:57.263435 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138accd-b13b-40b7-bb2e-4606aaa8d837 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:57.263709 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138accd-b13b-40b7-bb2e-4606aaa8d837 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:57.264276 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138accd-b13b-40b7-bb2e-4606aaa8d837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:57.278643 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5670c3-3b6e-405e-9c50-de4f1d3a8f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:57.279697 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5670c3-3b6e-405e-9c50-de4f1d3a8f9c None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:57.280189 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5670c3-3b6e-405e-9c50-de4f1d3a8f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:57.280691 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5670c3-3b6e-405e-9c50-de4f1d3a8f9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:57.283298 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-3138accd-b13b-40b7-bb2e-4606aaa8d837 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:04:57.284652 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3138accd-b13b-40b7-bb2e-4606aaa8d837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:04:57.361337 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:57.378208 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 94/183] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:04:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:04:57.378488 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5670c3-3b6e-405e-9c50-de4f1d3a8f9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:57.379062 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3138accd-b13b-40b7-bb2e-4606aaa8d837 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:57.380328 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5670c3-3b6e-405e-9c50-de4f1d3a8f9c None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:57.404423 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:57.490020 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 90/184] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Jun 18 04:04:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 04:04:57.491298 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e88955-6005-4e45-9fc7-ea698ce7b2b9 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:57.491584 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e88955-6005-4e45-9fc7-ea698ce7b2b9 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:57.491855 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e88955-6005-4e45-9fc7-ea698ce7b2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:57.495775 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3138accd-b13b-40b7-bb2e-4606aaa8d837 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:57.507604 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-c3e88955-6005-4e45-9fc7-ea698ce7b2b9 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:04:57.508806 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c3e88955-6005-4e45-9fc7-ea698ce7b2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:04:57.530298 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e7e40-84a5-46a2-98ea-59870a23b8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:57.531014 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e7e40-84a5-46a2-98ea-59870a23b8d8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:57.531287 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e7e40-84a5-46a2-98ea-59870a23b8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:57.531561 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e7e40-84a5-46a2-98ea-59870a23b8d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:57.532375 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707e7e40-84a5-46a2-98ea-59870a23b8d8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:04:57.532705 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707e7e40-84a5-46a2-98ea-59870a23b8d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:57.534097 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707e7e40-84a5-46a2-98ea-59870a23b8d8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:57.541916 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 95/185] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Jun 18 04:04:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:57.542764 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e7e40-84a5-46a2-98ea-59870a23b8d8 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:57.579273 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 91/186] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:04:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:04:57.582204 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8b2009-8ba3-4a04-b169-0c5b7cabe080 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:57.582543 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8b2009-8ba3-4a04-b169-0c5b7cabe080 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:57.582820 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8b2009-8ba3-4a04-b169-0c5b7cabe080 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:57.586135 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 92/187] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:04:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:04:57.586135 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8b2009-8ba3-4a04-b169-0c5b7cabe080 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:57.610779 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:57.626170 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:57.641820 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e7e40-84a5-46a2-98ea-59870a23b8d8 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:57.674329 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77127317-729a-444a-a905-9b1f66e52313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:57.675118 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77127317-729a-444a-a905-9b1f66e52313 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:57.675392 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77127317-729a-444a-a905-9b1f66e52313 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:57.675654 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77127317-729a-444a-a905-9b1f66e52313 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:57.685638 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77127317-729a-444a-a905-9b1f66e52313 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:04:57.688978 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8b2009-8ba3-4a04-b169-0c5b7cabe080 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:57.693509 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-77127317-729a-444a-a905-9b1f66e52313 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 04:04:57.693509 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:04:57.693509 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:04:57.693509 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:04:57.693509 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:04:57.693509 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:04:57.693509 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:04:57.693509 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:04:57.693509 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:04:57.693509 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:04:57.693509 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:04:57.693509 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:04:57.693509 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:04:57.693509 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:04:57.693509 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:04:57.693509 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:04:57.694466 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:04:57.694466 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:04:57.694466 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:04:57.694466 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:04:57.694466 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:04:57.694466 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:04:57.694466 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:04:57.694466 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:04:57.694466 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:04:57.694466 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:04:57.694466 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:04:57.694466 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:04:57.694466 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:04:57.694466 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:04:57.694466 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:04:57.694466 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:04:57.695247 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:04:57.695247 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:04:57.695247 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:04:57.695247 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:04:57.695247 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:04:57.695247 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:04:57.695247 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:04:57.695247 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:04:57.695247 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:04:57.695247 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:04:57.695247 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 04:04:57.695247 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:04:57.695247 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 96/188] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Jun 18 04:04:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:04:57.695880 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77127317-729a-444a-a905-9b1f66e52313 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:57.726895 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de664b0f-f2fb-4ba2-8824-b548472298e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:57.727758 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de664b0f-f2fb-4ba2-8824-b548472298e2 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:57.728033 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de664b0f-f2fb-4ba2-8824-b548472298e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:57.728300 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de664b0f-f2fb-4ba2-8824-b548472298e2 None admin] PATH_INFO: `/v3/projects/a709e1adfafe4068bb500cc3bec8353e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:57.729548 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de664b0f-f2fb-4ba2-8824-b548472298e2 None admin] RBAC: Authorizing `identity:get_project(project_id=a709e1adfafe4068bb500cc3bec8353e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:57.731032 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de664b0f-f2fb-4ba2-8824-b548472298e2 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:57.732764 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 93/189] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Jun 18 04:04:57 2022] GET /identity/v3/projects/a709e1adfafe4068bb500cc3bec8353e => generated 312 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:57.733891 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afa2f6-2927-4dfd-8360-a51f61ec61b6 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:57.734168 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afa2f6-2927-4dfd-8360-a51f61ec61b6 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:57.734781 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afa2f6-2927-4dfd-8360-a51f61ec61b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:57.751056 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-c3afa2f6-2927-4dfd-8360-a51f61ec61b6 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:04:57.752178 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c3afa2f6-2927-4dfd-8360-a51f61ec61b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:04:57.800147 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77127317-729a-444a-a905-9b1f66e52313 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:57.817909 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 94/190] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:04:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:04:57.818717 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3afa2f6-2927-4dfd-8360-a51f61ec61b6 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:57.832846 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926ef40-35f7-403c-b8a9-140ebb610c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:57.833743 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926ef40-35f7-403c-b8a9-140ebb610c53 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:57.834014 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926ef40-35f7-403c-b8a9-140ebb610c53 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:57.834281 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926ef40-35f7-403c-b8a9-140ebb610c53 None admin] PATH_INFO: `/v3/users/b4a74d58f6974f58bf43496f6df8176e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:57.846705 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:57.850316 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8926ef40-35f7-403c-b8a9-140ebb610c53 None admin] RBAC: Authorizing `identity:get_user(user_id=b4a74d58f6974f58bf43496f6df8176e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:57.851774 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8926ef40-35f7-403c-b8a9-140ebb610c53 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:57.853510 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 97/191] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Jun 18 04:04:57 2022] GET /identity/v3/users/b4a74d58f6974f58bf43496f6df8176e => generated 283 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:57.854337 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926ef40-35f7-403c-b8a9-140ebb610c53 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:57.858102 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:57.927821 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3afa2f6-2927-4dfd-8360-a51f61ec61b6 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:57.951443 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926ef40-35f7-403c-b8a9-140ebb610c53 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:57.960706 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8863cf00-5261-4ca7-a18e-49b55acfcb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:57.961519 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8863cf00-5261-4ca7-a18e-49b55acfcb8b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:57.961796 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8863cf00-5261-4ca7-a18e-49b55acfcb8b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:57.962068 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8863cf00-5261-4ca7-a18e-49b55acfcb8b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:57.963245 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8863cf00-5261-4ca7-a18e-49b55acfcb8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:57.965396 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8863cf00-5261-4ca7-a18e-49b55acfcb8b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:57.968304 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 95/192] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:04:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:57.969538 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8863cf00-5261-4ca7-a18e-49b55acfcb8b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:57.997351 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de62197-8d65-48ee-baa1-e1abd72e4e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:57.998021 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de62197-8d65-48ee-baa1-e1abd72e4e2e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:57.998296 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de62197-8d65-48ee-baa1-e1abd72e4e2e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:57.998566 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de62197-8d65-48ee-baa1-e1abd72e4e2e None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:57.999321 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de62197-8d65-48ee-baa1-e1abd72e4e2e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:04:57.999618 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de62197-8d65-48ee-baa1-e1abd72e4e2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:58.001036 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de62197-8d65-48ee-baa1-e1abd72e4e2e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:58.009495 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 98/193] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Jun 18 04:04:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:58.010217 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de62197-8d65-48ee-baa1-e1abd72e4e2e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:58.059094 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:58.070360 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:58.074461 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8863cf00-5261-4ca7-a18e-49b55acfcb8b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:58.107072 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de62197-8d65-48ee-baa1-e1abd72e4e2e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:58.108424 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da0c6d5-ae0e-447e-884e-ee8c4574a142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:58.109113 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0c6d5-ae0e-447e-884e-ee8c4574a142 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:58.109732 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0c6d5-ae0e-447e-884e-ee8c4574a142 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:58.110011 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0c6d5-ae0e-447e-884e-ee8c4574a142 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:58.110843 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da0c6d5-ae0e-447e-884e-ee8c4574a142 None admin] RBAC: Adding query filter params (role.id=d74f7ad64e584e6186564837fa3cf380, scope.project.id=a709e1adfafe4068bb500cc3bec8353e, user.id=732d81d4380b4131ac8b88c9215b9c7f) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:04:58.111151 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da0c6d5-ae0e-447e-884e-ee8c4574a142 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:58.112622 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da0c6d5-ae0e-447e-884e-ee8c4574a142 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:58.119134 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 96/194] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Jun 18 04:04:57 2022] GET /identity/v3/role_assignments?user.id=732d81d4380b4131ac8b88c9215b9c7f&scope.project.id=a709e1adfafe4068bb500cc3bec8353e&role.id=d74f7ad64e584e6186564837fa3cf380 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:58.119907 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da0c6d5-ae0e-447e-884e-ee8c4574a142 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:58.156737 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab229f8-d5a2-42e9-8947-c6d4e1a9ceaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:58.157562 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab229f8-d5a2-42e9-8947-c6d4e1a9ceaf None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:58.157838 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab229f8-d5a2-42e9-8947-c6d4e1a9ceaf None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:58.158102 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab229f8-d5a2-42e9-8947-c6d4e1a9ceaf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:58.169858 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab229f8-d5a2-42e9-8947-c6d4e1a9ceaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:04:58.177789 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-aab229f8-d5a2-42e9-8947-c6d4e1a9ceaf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 18 04:04:58.177789 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:04:58.177789 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:04:58.177789 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:04:58.177789 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:04:58.177789 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:04:58.177789 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:04:58.177789 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:04:58.177789 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:04:58.177789 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:04:58.177789 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:04:58.177789 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:04:58.177789 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:04:58.177789 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:04:58.177789 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:04:58.177789 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:04:58.178747 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:04:58.178747 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:04:58.178747 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:04:58.178747 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:04:58.178747 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:04:58.178747 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:04:58.178747 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:04:58.178747 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:04:58.178747 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:04:58.178747 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:04:58.178747 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:04:58.178747 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:04:58.178747 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:04:58.178747 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:04:58.178747 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:04:58.178747 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:04:58.179566 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:04:58.179566 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:04:58.179566 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:04:58.179566 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:04:58.179566 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:04:58.179566 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:04:58.179566 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:04:58.179566 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:04:58.179566 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:04:58.179566 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:04:58.179566 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 18 04:04:58.179566 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:04:58.179566 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 99/195] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Jun 18 04:04:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:04:58.180196 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab229f8-d5a2-42e9-8947-c6d4e1a9ceaf None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:58.245751 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da0c6d5-ae0e-447e-884e-ee8c4574a142 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:58.286446 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c2a4f9-b34f-4fbe-ade7-931774d39107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:58.287001 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2a4f9-b34f-4fbe-ade7-931774d39107 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:58.287276 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2a4f9-b34f-4fbe-ade7-931774d39107 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:58.287550 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2a4f9-b34f-4fbe-ade7-931774d39107 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:58.292913 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab229f8-d5a2-42e9-8947-c6d4e1a9ceaf None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:58.307993 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:58.320871 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:58.332815 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb323c3d-5195-49e4-a8f2-9084e5943135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:58.333911 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb323c3d-5195-49e4-a8f2-9084e5943135 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:58.333911 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb323c3d-5195-49e4-a8f2-9084e5943135 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:58.334114 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb323c3d-5195-49e4-a8f2-9084e5943135 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:58.334827 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb323c3d-5195-49e4-a8f2-9084e5943135 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:58.336412 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb323c3d-5195-49e4-a8f2-9084e5943135 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:58.361553 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 100/196] 10.222.0.20 () {60 vars in 1132 bytes} [Sat Jun 18 04:04:58 2022] POST /identity/v3/users => generated 297 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 04:04:58.366171 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb323c3d-5195-49e4-a8f2-9084e5943135 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:58.366769 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c2a4f9-b34f-4fbe-ade7-931774d39107 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:58.369116 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c2a4f9-b34f-4fbe-ade7-931774d39107 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:58.482350 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 97/197] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Jun 18 04:04:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 04:04:58.483305 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c2a4f9-b34f-4fbe-ade7-931774d39107 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:58.495718 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb323c3d-5195-49e4-a8f2-9084e5943135 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:58.540020 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5253ca-0a56-4e07-a83a-67b35e26d5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:58.540891 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5253ca-0a56-4e07-a83a-67b35e26d5f1 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:58.541053 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:58.541168 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5253ca-0a56-4e07-a83a-67b35e26d5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:58.541433 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5253ca-0a56-4e07-a83a-67b35e26d5f1 None admin] PATH_INFO: `/v3/users/b4a74d58f6974f58bf43496f6df8176e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:58.542726 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5253ca-0a56-4e07-a83a-67b35e26d5f1 None admin] RBAC: Authorizing `identity:get_user(user_id=b4a74d58f6974f58bf43496f6df8176e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:58.544223 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5253ca-0a56-4e07-a83a-67b35e26d5f1 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:58.550540 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 101/198] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Jun 18 04:04:58 2022] GET /identity/v3/users/b4a74d58f6974f58bf43496f6df8176e => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:58.550540 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5253ca-0a56-4e07-a83a-67b35e26d5f1 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:58.595512 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c2a4f9-b34f-4fbe-ade7-931774d39107 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:58.602273 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:58.638332 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833c1a2-a19b-4576-a7f4-7f2283d0792b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:58.639025 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833c1a2-a19b-4576-a7f4-7f2283d0792b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:58.639820 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833c1a2-a19b-4576-a7f4-7f2283d0792b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:58.639820 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833c1a2-a19b-4576-a7f4-7f2283d0792b None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:58.640300 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0833c1a2-a19b-4576-a7f4-7f2283d0792b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:04:58.640669 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0833c1a2-a19b-4576-a7f4-7f2283d0792b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:58.642080 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0833c1a2-a19b-4576-a7f4-7f2283d0792b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:58.652289 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 98/199] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Jun 18 04:04:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:58.653191 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833c1a2-a19b-4576-a7f4-7f2283d0792b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:58.671278 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5253ca-0a56-4e07-a83a-67b35e26d5f1 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:58.709301 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b7596e-046e-461e-bf60-f56e80a4d43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:58.710178 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7596e-046e-461e-bf60-f56e80a4d43f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:58.710462 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7596e-046e-461e-bf60-f56e80a4d43f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:58.710726 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7596e-046e-461e-bf60-f56e80a4d43f None admin] PATH_INFO: `/v3/projects/a7f9d08dadd24d78b125397d1904ae7d` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:58.711904 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b7596e-046e-461e-bf60-f56e80a4d43f None admin] RBAC: Authorizing `identity:get_project(project_id=a7f9d08dadd24d78b125397d1904ae7d)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:58.713383 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b7596e-046e-461e-bf60-f56e80a4d43f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:58.715419 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 102/200] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Jun 18 04:04:58 2022] GET /identity/v3/projects/a7f9d08dadd24d78b125397d1904ae7d => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:58.716112 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b7596e-046e-461e-bf60-f56e80a4d43f None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:58.771819 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833c1a2-a19b-4576-a7f4-7f2283d0792b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:58.785213 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:58.807093 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d818d1-531a-4b88-bce6-fd20100ab823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:58.807540 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d818d1-531a-4b88-bce6-fd20100ab823 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:58.807939 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d818d1-531a-4b88-bce6-fd20100ab823 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:58.808219 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d818d1-531a-4b88-bce6-fd20100ab823 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:58.835137 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b7596e-046e-461e-bf60-f56e80a4d43f None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:58.853562 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:58.873884 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e63cc9-1dc8-4b2f-ac38-fb8bfebbb5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:58.875164 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e63cc9-1dc8-4b2f-ac38-fb8bfebbb5bd None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:58.875638 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e63cc9-1dc8-4b2f-ac38-fb8bfebbb5bd None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:58.876321 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e63cc9-1dc8-4b2f-ac38-fb8bfebbb5bd None admin] PATH_INFO: `/v3/users/adb92e9a455f4a6498d4e82112f55eb9` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:58.877817 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e63cc9-1dc8-4b2f-ac38-fb8bfebbb5bd None admin] RBAC: Authorizing `identity:get_user(user_id=adb92e9a455f4a6498d4e82112f55eb9)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:58.878157 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d818d1-531a-4b88-bce6-fd20100ab823 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:58.879644 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d818d1-531a-4b88-bce6-fd20100ab823 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:58.879911 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e63cc9-1dc8-4b2f-ac38-fb8bfebbb5bd None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:58.881940 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 103/201] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Jun 18 04:04:58 2022] GET /identity/v3/users/adb92e9a455f4a6498d4e82112f55eb9 => generated 289 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:58.882969 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e63cc9-1dc8-4b2f-ac38-fb8bfebbb5bd None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:58.981359 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 99/202] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Jun 18 04:04:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 04:04:58.982045 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d818d1-531a-4b88-bce6-fd20100ab823 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:58.995244 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e63cc9-1dc8-4b2f-ac38-fb8bfebbb5bd None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:58.998714 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:59.030476 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a773f-1a67-40eb-a4b1-c134f01431b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:59.031179 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a773f-1a67-40eb-a4b1-c134f01431b8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:59.031457 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a773f-1a67-40eb-a4b1-c134f01431b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:59.031724 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a773f-1a67-40eb-a4b1-c134f01431b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:59.032563 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767a773f-1a67-40eb-a4b1-c134f01431b8 None admin] RBAC: Adding query filter params (role.id=ba29217afc57483a90e90b287c480549, scope.project.id=a7f9d08dadd24d78b125397d1904ae7d, user.id=b4a74d58f6974f58bf43496f6df8176e) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:04:59.033464 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767a773f-1a67-40eb-a4b1-c134f01431b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:59.035000 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767a773f-1a67-40eb-a4b1-c134f01431b8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:59.041410 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 104/203] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Jun 18 04:04:58 2022] GET /identity/v3/role_assignments?user.id=b4a74d58f6974f58bf43496f6df8176e&scope.project.id=a7f9d08dadd24d78b125397d1904ae7d&role.id=ba29217afc57483a90e90b287c480549 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:59.042538 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a773f-1a67-40eb-a4b1-c134f01431b8 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:59.090896 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d818d1-531a-4b88-bce6-fd20100ab823 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:59.097686 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:59.129301 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269005d-28c1-4741-b1c4-4e72b09a21ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:59.129968 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269005d-28c1-4741-b1c4-4e72b09a21ae None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:59.130244 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269005d-28c1-4741-b1c4-4e72b09a21ae None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:59.130515 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269005d-28c1-4741-b1c4-4e72b09a21ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:59.155663 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a773f-1a67-40eb-a4b1-c134f01431b8 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:59.192406 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874391f1-a0ec-4549-bd29-b39f8bdaa2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:59.193521 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874391f1-a0ec-4549-bd29-b39f8bdaa2f4 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:59.193797 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874391f1-a0ec-4549-bd29-b39f8bdaa2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:59.194111 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874391f1-a0ec-4549-bd29-b39f8bdaa2f4 None admin] PATH_INFO: `/v3/projects/a7f9d08dadd24d78b125397d1904ae7d` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:59.195353 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874391f1-a0ec-4549-bd29-b39f8bdaa2f4 None admin] RBAC: Authorizing `identity:get_project(project_id=a7f9d08dadd24d78b125397d1904ae7d)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:59.197102 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874391f1-a0ec-4549-bd29-b39f8bdaa2f4 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:59.199346 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 105/204] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Jun 18 04:04:59 2022] GET /identity/v3/projects/a7f9d08dadd24d78b125397d1904ae7d => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:59.203534 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2269005d-28c1-4741-b1c4-4e72b09a21ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:59.205087 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2269005d-28c1-4741-b1c4-4e72b09a21ae None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:59.205298 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874391f1-a0ec-4549-bd29-b39f8bdaa2f4 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:59.221120 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:59.332245 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874391f1-a0ec-4549-bd29-b39f8bdaa2f4 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:59.333691 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 100/205] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Jun 18 04:04:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 04:04:59.339419 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269005d-28c1-4741-b1c4-4e72b09a21ae None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:59.352938 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:59.377821 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f8cbe4-1e91-4801-972d-041c33c41ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:59.378715 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8cbe4-1e91-4801-972d-041c33c41ceb None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:59.379129 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8cbe4-1e91-4801-972d-041c33c41ceb None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:59.379516 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8cbe4-1e91-4801-972d-041c33c41ceb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:59.381677 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f8cbe4-1e91-4801-972d-041c33c41ceb None admin] RBAC: Adding query filter params (role.id=d783a633c75847d48ef7ef5b169b0313, scope.project.id=a7f9d08dadd24d78b125397d1904ae7d, user.id=b4a74d58f6974f58bf43496f6df8176e) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:04:59.382160 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f8cbe4-1e91-4801-972d-041c33c41ceb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:59.383751 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f8cbe4-1e91-4801-972d-041c33c41ceb None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:59.390940 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 106/206] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Jun 18 04:04:59 2022] GET /identity/v3/role_assignments?user.id=b4a74d58f6974f58bf43496f6df8176e&scope.project.id=a7f9d08dadd24d78b125397d1904ae7d&role.id=d783a633c75847d48ef7ef5b169b0313 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:59.467696 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269005d-28c1-4741-b1c4-4e72b09a21ae None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:59.485532 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:04:59.509373 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb1402-c017-4f5e-8b97-4f6a60a1e5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:59.510456 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb1402-c017-4f5e-8b97-4f6a60a1e5d8 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:59.510814 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb1402-c017-4f5e-8b97-4f6a60a1e5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:59.511088 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb1402-c017-4f5e-8b97-4f6a60a1e5d8 None admin] PATH_INFO: `/v3/projects/594195ae8d4c49c8babdbc7125c60372` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:59.512408 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eb1402-c017-4f5e-8b97-4f6a60a1e5d8 None admin] RBAC: Authorizing `identity:get_project(project_id=594195ae8d4c49c8babdbc7125c60372)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:59.514031 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eb1402-c017-4f5e-8b97-4f6a60a1e5d8 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:59.516165 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 101/207] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Jun 18 04:04:59 2022] GET /identity/v3/projects/594195ae8d4c49c8babdbc7125c60372 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:04:59.521965 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f8cbe4-1e91-4801-972d-041c33c41ceb None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:04:59.632041 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f8cbe4-1e91-4801-972d-041c33c41ceb None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:04:59.666465 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92473453-3706-40c4-b149-6cbc607f8f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:04:59.667581 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92473453-3706-40c4-b149-6cbc607f8f37 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:04:59.668051 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92473453-3706-40c4-b149-6cbc607f8f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:04:59.668510 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92473453-3706-40c4-b149-6cbc607f8f37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:04:59.669548 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92473453-3706-40c4-b149-6cbc607f8f37 None admin] RBAC: Adding query filter params (role.id=3af5984773ef41448b3d4ef5e617e090, scope.project.id=594195ae8d4c49c8babdbc7125c60372, user.id=adb92e9a455f4a6498d4e82112f55eb9) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:04:59.670045 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92473453-3706-40c4-b149-6cbc607f8f37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:04:59.671764 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92473453-3706-40c4-b149-6cbc607f8f37 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:04:59.681021 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 107/208] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Jun 18 04:04:59 2022] GET /identity/v3/role_assignments?user.id=adb92e9a455f4a6498d4e82112f55eb9&scope.project.id=594195ae8d4c49c8babdbc7125c60372&role.id=3af5984773ef41448b3d4ef5e617e090 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:00.702504 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fed30f-292a-4d77-90e9-f7c70b21cdda None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:00.703028 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fed30f-292a-4d77-90e9-f7c70b21cdda None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:00.703028 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fed30f-292a-4d77-90e9-f7c70b21cdda None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:00.704719 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 102/209] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:05:00.709920 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a237ce-526c-4d62-8283-ffc37e373d4b None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:00.710699 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a237ce-526c-4d62-8283-ffc37e373d4b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:00.711170 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a237ce-526c-4d62-8283-ffc37e373d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:00.728529 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-76a237ce-526c-4d62-8283-ffc37e373d4b None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:00.730078 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-76a237ce-526c-4d62-8283-ffc37e373d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:00.773920 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:00.808672 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 108/210] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 18 04:05:00.827022 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fed30f-292a-4d77-90e9-f7c70b21cdda None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:00.931891 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fed30f-292a-4d77-90e9-f7c70b21cdda None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:00.968952 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51961ea-7ad7-4db1-b266-b19ec788becb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:00.969766 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51961ea-7ad7-4db1-b266-b19ec788becb None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:00.970046 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51961ea-7ad7-4db1-b266-b19ec788becb None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:00.970314 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51961ea-7ad7-4db1-b266-b19ec788becb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:00.981454 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51961ea-7ad7-4db1-b266-b19ec788becb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:05:00.989610 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-a51961ea-7ad7-4db1-b266-b19ec788becb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 18 04:05:00.989610 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:00.989610 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:00.989610 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:00.989610 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:00.989610 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:00.989610 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:00.989610 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:00.989610 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:00.989610 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:00.989610 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:00.989610 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:00.989610 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:05:00.989610 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:05:00.989610 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:05:00.989610 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:05:00.990480 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:05:00.990480 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:05:00.990480 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:05:00.990480 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:05:00.990480 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:00.990480 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:00.990480 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:00.990480 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:00.990480 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:00.990480 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:00.990480 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:00.990480 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:00.990480 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:00.990480 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:00.990480 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:00.990480 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:00.991699 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:00.991699 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:00.991699 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:00.991699 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:00.991699 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:05:00.991699 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:05:00.991699 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:05:00.991699 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:05:00.991699 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:05:00.991699 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:05:00.991699 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 18 04:05:00.991699 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:05:00.991699 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 103/211] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Jun 18 04:05:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:00.998725 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a237ce-526c-4d62-8283-ffc37e373d4b None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:01.011325 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a8e76-1176-4f4f-9049-304dcf33658a None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:01.011621 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a8e76-1176-4f4f-9049-304dcf33658a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:01.011875 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a8e76-1176-4f4f-9049-304dcf33658a None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:01.013450 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 104/212] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:05:01.018976 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157c6d2-a5ce-4146-8798-1fdaf447b97e None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:01.019255 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157c6d2-a5ce-4146-8798-1fdaf447b97e None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:01.019525 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157c6d2-a5ce-4146-8798-1fdaf447b97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:01.041028 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-3157c6d2-a5ce-4146-8798-1fdaf447b97e None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:01.042391 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-3157c6d2-a5ce-4146-8798-1fdaf447b97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:01.092796 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:01.118458 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a237ce-526c-4d62-8283-ffc37e373d4b None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:01.140650 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 105/213] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:05:01.159725 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff30a6ce-8a5a-4c81-a7c9-de08a0cbd9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:01.160755 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30a6ce-8a5a-4c81-a7c9-de08a0cbd9e5 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:01.161234 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30a6ce-8a5a-4c81-a7c9-de08a0cbd9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:01.162805 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3157c6d2-a5ce-4146-8798-1fdaf447b97e None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:01.164820 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30a6ce-8a5a-4c81-a7c9-de08a0cbd9e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:01.167200 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff30a6ce-8a5a-4c81-a7c9-de08a0cbd9e5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:01.167717 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff30a6ce-8a5a-4c81-a7c9-de08a0cbd9e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:01.169343 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff30a6ce-8a5a-4c81-a7c9-de08a0cbd9e5 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:01.180919 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 109/214] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Jun 18 04:05:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:01.187200 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff30a6ce-8a5a-4c81-a7c9-de08a0cbd9e5 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:01.226303 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:01.294330 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3157c6d2-a5ce-4146-8798-1fdaf447b97e None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:01.300927 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff30a6ce-8a5a-4c81-a7c9-de08a0cbd9e5 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:01.330877 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a79407-5459-4cab-a2d3-4824b9e1a685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:01.332247 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a79407-5459-4cab-a2d3-4824b9e1a685 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:01.332872 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a79407-5459-4cab-a2d3-4824b9e1a685 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:01.333317 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a79407-5459-4cab-a2d3-4824b9e1a685 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:01.335152 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a79407-5459-4cab-a2d3-4824b9e1a685 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:01.337532 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a79407-5459-4cab-a2d3-4824b9e1a685 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:01.344963 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 106/215] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:05:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:05:01.345739 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29898dc3-5dc8-4218-b905-bfa378255359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:01.346630 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29898dc3-5dc8-4218-b905-bfa378255359 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:01.346903 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29898dc3-5dc8-4218-b905-bfa378255359 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:01.347170 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29898dc3-5dc8-4218-b905-bfa378255359 None admin] PATH_INFO: `/v3/users/300bf1ac59b447b58ba665fd2e02aa73` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:01.348650 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a79407-5459-4cab-a2d3-4824b9e1a685 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:01.364275 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29898dc3-5dc8-4218-b905-bfa378255359 None admin] RBAC: Authorizing `identity:get_user(user_id=300bf1ac59b447b58ba665fd2e02aa73)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:01.366195 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29898dc3-5dc8-4218-b905-bfa378255359 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:01.372897 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 110/216] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Jun 18 04:05:01 2022] GET /identity/v3/users/300bf1ac59b447b58ba665fd2e02aa73 => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:05:01.374145 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e45dc-843a-4755-a42d-e46db16987b7 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:01.374430 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e45dc-843a-4755-a42d-e46db16987b7 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:01.374696 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e45dc-843a-4755-a42d-e46db16987b7 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:01.376140 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 111/217] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:05:01.376736 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e45dc-843a-4755-a42d-e46db16987b7 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:01.392885 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:01.463358 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a79407-5459-4cab-a2d3-4824b9e1a685 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:01.479693 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:01.491723 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e45dc-843a-4755-a42d-e46db16987b7 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:01.499346 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a506d-f78d-4cb5-885e-67d3b25fe826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:01.500075 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a506d-f78d-4cb5-885e-67d3b25fe826 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:01.500352 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a506d-f78d-4cb5-885e-67d3b25fe826 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:01.500828 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a506d-f78d-4cb5-885e-67d3b25fe826 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:01.501682 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a506d-f78d-4cb5-885e-67d3b25fe826 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:01.503263 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a506d-f78d-4cb5-885e-67d3b25fe826 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:01.524994 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 107/218] 10.222.0.20 () {60 vars in 1132 bytes} [Sat Jun 18 04:05:01 2022] POST /identity/v3/users => generated 297 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 04:05:01.526526 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf062d44-2037-4618-a195-9f4cff4a9bcf None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:01.526985 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf062d44-2037-4618-a195-9f4cff4a9bcf None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:01.527387 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf062d44-2037-4618-a195-9f4cff4a9bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:01.539131 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1317311-a389-40f5-8b28-96bb929c5985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:01.540807 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1317311-a389-40f5-8b28-96bb929c5985 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:01.541217 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1317311-a389-40f5-8b28-96bb929c5985 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:01.541567 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1317311-a389-40f5-8b28-96bb929c5985 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:01.546759 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-bf062d44-2037-4618-a195-9f4cff4a9bcf None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:01.548231 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-bf062d44-2037-4618-a195-9f4cff4a9bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:01.625539 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 108/219] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:05:01.627792 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1317311-a389-40f5-8b28-96bb929c5985 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:01.629332 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1317311-a389-40f5-8b28-96bb929c5985 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:01.634181 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b239b-7157-46ee-87f3-766f81b3321d None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:01.634466 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b239b-7157-46ee-87f3-766f81b3321d None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:01.634738 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b239b-7157-46ee-87f3-766f81b3321d None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:01.636212 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 109/220] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:01 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:05:01.641935 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378a948-a3a3-4278-a2f5-7f5b40ff6b53 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:01.642416 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378a948-a3a3-4278-a2f5-7f5b40ff6b53 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:01.642827 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378a948-a3a3-4278-a2f5-7f5b40ff6b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:01.661570 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-4378a948-a3a3-4278-a2f5-7f5b40ff6b53 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:01.662791 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-4378a948-a3a3-4278-a2f5-7f5b40ff6b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:01.684296 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:01.748054 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 110/221] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:05:01.749458 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4378a948-a3a3-4278-a2f5-7f5b40ff6b53 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:01.756469 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:01.764760 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 112/222] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Jun 18 04:05:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 04:05:01.770543 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1317311-a389-40f5-8b28-96bb929c5985 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:01.875309 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4378a948-a3a3-4278-a2f5-7f5b40ff6b53 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:01.891227 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1317311-a389-40f5-8b28-96bb929c5985 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:01.919807 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bca60b-418f-411e-8b3b-af77e7690bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:01.921364 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bca60b-418f-411e-8b3b-af77e7690bfb None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:01.921640 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bca60b-418f-411e-8b3b-af77e7690bfb None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:01.922182 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bca60b-418f-411e-8b3b-af77e7690bfb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:01.928610 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c905273-465a-4047-92a0-d81d951efbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:01.929505 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c905273-465a-4047-92a0-d81d951efbb9 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:01.929778 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c905273-465a-4047-92a0-d81d951efbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:01.930044 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c905273-465a-4047-92a0-d81d951efbb9 None admin] PATH_INFO: `/v3/projects/a7f9d08dadd24d78b125397d1904ae7d` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:01.931244 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c905273-465a-4047-92a0-d81d951efbb9 None admin] RBAC: Authorizing `identity:get_project(project_id=a7f9d08dadd24d78b125397d1904ae7d)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:01.932798 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c905273-465a-4047-92a0-d81d951efbb9 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:01.934526 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 113/223] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Jun 18 04:05:01 2022] GET /identity/v3/projects/a7f9d08dadd24d78b125397d1904ae7d => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:05:01.934920 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bca60b-418f-411e-8b3b-af77e7690bfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:05:01.935612 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c905273-465a-4047-92a0-d81d951efbb9 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:01.945423 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-14bca60b-418f-411e-8b3b-af77e7690bfb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 18 04:05:01.945423 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:01.945423 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:01.945423 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:01.945423 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:01.945423 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:01.945423 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:01.945423 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:01.945423 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:01.945423 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:01.945423 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:01.945423 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:01.945423 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:05:01.945423 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:05:01.945423 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:05:01.945423 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:05:01.946522 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:05:01.946522 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:05:01.946522 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:05:01.946522 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:05:01.946522 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:01.946522 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:01.946522 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:01.946522 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:01.946522 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:01.946522 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:01.946522 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:01.946522 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:01.946522 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:01.946522 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:01.946522 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:01.946522 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:01.947481 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:01.947481 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:01.947481 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:01.947481 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:01.947481 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:05:01.947481 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:05:01.947481 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:05:01.947481 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:05:01.947481 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:05:01.947481 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:05:01.947481 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 18 04:05:01.947481 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:05:01.947481 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 111/224] 10.222.0.20 () {56 vars in 1114 bytes} [Sat Jun 18 04:05:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:01.948239 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bca60b-418f-411e-8b3b-af77e7690bfb None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:01.975548 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:02.018261 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:02.060032 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c905273-465a-4047-92a0-d81d951efbb9 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:02.065123 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bca60b-418f-411e-8b3b-af77e7690bfb None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:02.102411 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff52439-96fb-4b74-9cef-261396498392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:02.103487 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d694069d-8569-4f41-a51b-9e71276b3e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:02.103653 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff52439-96fb-4b74-9cef-261396498392 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:02.103745 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff52439-96fb-4b74-9cef-261396498392 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:02.104018 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff52439-96fb-4b74-9cef-261396498392 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:02.105065 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694069d-8569-4f41-a51b-9e71276b3e1b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:02.105225 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff52439-96fb-4b74-9cef-261396498392 None admin] RBAC: Adding query filter params (role.id=d74f7ad64e584e6186564837fa3cf380, scope.project.id=a7f9d08dadd24d78b125397d1904ae7d, user.id=300bf1ac59b447b58ba665fd2e02aa73) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:02.105433 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff52439-96fb-4b74-9cef-261396498392 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:02.106127 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694069d-8569-4f41-a51b-9e71276b3e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:02.106767 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694069d-8569-4f41-a51b-9e71276b3e1b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:02.106928 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff52439-96fb-4b74-9cef-261396498392 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:02.114671 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 112/225] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Jun 18 04:05:01 2022] GET /identity/v3/role_assignments?user.id=300bf1ac59b447b58ba665fd2e02aa73&scope.project.id=a7f9d08dadd24d78b125397d1904ae7d&role.id=d74f7ad64e584e6186564837fa3cf380 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:02.115744 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff52439-96fb-4b74-9cef-261396498392 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:02.125346 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d694069d-8569-4f41-a51b-9e71276b3e1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:05:02.137300 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-d694069d-8569-4f41-a51b-9e71276b3e1b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 04:05:02.137300 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:02.137300 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:02.137300 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:02.137300 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:02.137300 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:02.137300 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:02.137300 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:02.137300 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:02.137300 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:02.137300 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:02.137300 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:02.137300 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:05:02.137300 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:05:02.137300 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:05:02.137300 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:05:02.138433 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:05:02.138433 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:05:02.138433 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:05:02.138433 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:05:02.138433 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:02.138433 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:02.138433 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:02.138433 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:02.138433 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:02.138433 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:02.138433 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:02.138433 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:02.138433 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:02.138433 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:02.138433 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:02.138433 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:02.139402 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:02.139402 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:02.139402 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:02.139402 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:02.139402 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:05:02.139402 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:05:02.139402 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:05:02.139402 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:05:02.139402 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:05:02.139402 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:05:02.139402 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 04:05:02.139402 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:02.141613 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 114/226] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Jun 18 04:05:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:02.149026 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d694069d-8569-4f41-a51b-9e71276b3e1b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:02.253438 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:02.280561 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff52439-96fb-4b74-9cef-261396498392 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:02.326337 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d694069d-8569-4f41-a51b-9e71276b3e1b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:02.329927 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4055c4-fd3d-45de-87ac-82e542a2a989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:02.330604 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4055c4-fd3d-45de-87ac-82e542a2a989 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:02.330873 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4055c4-fd3d-45de-87ac-82e542a2a989 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:02.331139 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4055c4-fd3d-45de-87ac-82e542a2a989 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:02.331894 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4055c4-fd3d-45de-87ac-82e542a2a989 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:02.332191 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4055c4-fd3d-45de-87ac-82e542a2a989 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:02.333606 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4055c4-fd3d-45de-87ac-82e542a2a989 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:02.343531 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 113/227] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Jun 18 04:05:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:02.349552 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4055c4-fd3d-45de-87ac-82e542a2a989 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:02.354981 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:02.370277 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db19026-1f00-433b-b983-a011876bae70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:02.371212 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db19026-1f00-433b-b983-a011876bae70 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:02.371496 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db19026-1f00-433b-b983-a011876bae70 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:02.372157 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db19026-1f00-433b-b983-a011876bae70 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:02.372968 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db19026-1f00-433b-b983-a011876bae70 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:02.373278 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db19026-1f00-433b-b983-a011876bae70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:02.375248 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db19026-1f00-433b-b983-a011876bae70 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:02.387399 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 115/228] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Jun 18 04:05:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:02.392693 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db19026-1f00-433b-b983-a011876bae70 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:02.533313 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4055c4-fd3d-45de-87ac-82e542a2a989 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:02.557625 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db19026-1f00-433b-b983-a011876bae70 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:02.601518 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b6af9c-dfa4-482c-9ad5-a40058f69cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:02.603993 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6af9c-dfa4-482c-9ad5-a40058f69cd5 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:02.605520 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6af9c-dfa4-482c-9ad5-a40058f69cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:02.606752 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6af9c-dfa4-482c-9ad5-a40058f69cd5 None admin] PATH_INFO: `/v3/users/b4a74d58f6974f58bf43496f6df8176e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:02.610404 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b6af9c-dfa4-482c-9ad5-a40058f69cd5 None admin] RBAC: Authorizing `identity:get_user(user_id=b4a74d58f6974f58bf43496f6df8176e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:02.613257 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b6af9c-dfa4-482c-9ad5-a40058f69cd5 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:02.617168 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 114/229] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Jun 18 04:05:02 2022] GET /identity/v3/users/b4a74d58f6974f58bf43496f6df8176e => generated 283 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:02.627493 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b6af9c-dfa4-482c-9ad5-a40058f69cd5 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:02.633836 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e79e249-41cc-407b-8919-4c17e01283c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:02.634702 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79e249-41cc-407b-8919-4c17e01283c6 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:02.634979 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79e249-41cc-407b-8919-4c17e01283c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:02.635246 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79e249-41cc-407b-8919-4c17e01283c6 None admin] PATH_INFO: `/v3/users/b4a74d58f6974f58bf43496f6df8176e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:02.636602 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e79e249-41cc-407b-8919-4c17e01283c6 None admin] RBAC: Authorizing `identity:get_user(user_id=b4a74d58f6974f58bf43496f6df8176e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:02.638079 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e79e249-41cc-407b-8919-4c17e01283c6 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:02.639745 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 116/230] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Jun 18 04:05:02 2022] GET /identity/v3/users/b4a74d58f6974f58bf43496f6df8176e => generated 283 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:02.646795 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e79e249-41cc-407b-8919-4c17e01283c6 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:02.647433 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:02.748748 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:02.790551 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b6af9c-dfa4-482c-9ad5-a40058f69cd5 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:02.834959 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e79e249-41cc-407b-8919-4c17e01283c6 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:02.845264 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20f4649-350d-4e92-88fc-455c8ccb394b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:02.846510 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f4649-350d-4e92-88fc-455c8ccb394b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:02.846970 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f4649-350d-4e92-88fc-455c8ccb394b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:02.847410 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f4649-350d-4e92-88fc-455c8ccb394b None admin] PATH_INFO: `/v3/projects/a7f9d08dadd24d78b125397d1904ae7d` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:02.848949 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20f4649-350d-4e92-88fc-455c8ccb394b None admin] RBAC: Authorizing `identity:get_project(project_id=a7f9d08dadd24d78b125397d1904ae7d)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:02.850591 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20f4649-350d-4e92-88fc-455c8ccb394b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:02.856087 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 115/231] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Jun 18 04:05:02 2022] GET /identity/v3/projects/a7f9d08dadd24d78b125397d1904ae7d => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:05:02.860978 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20f4649-350d-4e92-88fc-455c8ccb394b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:02.914795 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f3f84d-5cdb-45a6-bf21-f51298db1cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:02.915678 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3f84d-5cdb-45a6-bf21-f51298db1cfd None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:02.915953 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3f84d-5cdb-45a6-bf21-f51298db1cfd None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:02.916219 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3f84d-5cdb-45a6-bf21-f51298db1cfd None admin] PATH_INFO: `/v3/projects/a7f9d08dadd24d78b125397d1904ae7d` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:02.918373 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f3f84d-5cdb-45a6-bf21-f51298db1cfd None admin] RBAC: Authorizing `identity:get_project(project_id=a7f9d08dadd24d78b125397d1904ae7d)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:02.919854 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f3f84d-5cdb-45a6-bf21-f51298db1cfd None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:02.924225 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 117/232] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Jun 18 04:05:02 2022] GET /identity/v3/projects/a7f9d08dadd24d78b125397d1904ae7d => generated 302 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:02.929197 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f3f84d-5cdb-45a6-bf21-f51298db1cfd None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:02.985119 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:03.028486 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20f4649-350d-4e92-88fc-455c8ccb394b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:03.093496 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57838d53-871c-4329-a15a-28fda71b0bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:03.094306 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57838d53-871c-4329-a15a-28fda71b0bcd None admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:03.094580 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57838d53-871c-4329-a15a-28fda71b0bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:03.094847 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57838d53-871c-4329-a15a-28fda71b0bcd None admin] PATH_INFO: `/v3/projects/a7f9d08dadd24d78b125397d1904ae7d/users/b4a74d58f6974f58bf43496f6df8176e/roles/ba29217afc57483a90e90b287c480549` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:03.098984 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57838d53-871c-4329-a15a-28fda71b0bcd None admin] RBAC: Authorizing `identity:create_grant(project_id=a7f9d08dadd24d78b125397d1904ae7d, user_id=b4a74d58f6974f58bf43496f6df8176e, role_id=ba29217afc57483a90e90b287c480549)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:03.100523 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57838d53-871c-4329-a15a-28fda71b0bcd None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:03.114052 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f3f84d-5cdb-45a6-bf21-f51298db1cfd None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:03.132722 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 116/233] 10.222.0.20 () {58 vars in 1439 bytes} [Sat Jun 18 04:05:02 2022] PUT /identity/v3/projects/a7f9d08dadd24d78b125397d1904ae7d/users/b4a74d58f6974f58bf43496f6df8176e/roles/ba29217afc57483a90e90b287c480549 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 04:05:03.148777 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:03.168892 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1297c3a1-c496-4998-980c-dee7b4a935c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:03.169852 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297c3a1-c496-4998-980c-dee7b4a935c5 None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:03.170138 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297c3a1-c496-4998-980c-dee7b4a935c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:03.170411 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297c3a1-c496-4998-980c-dee7b4a935c5 None admin] PATH_INFO: `/v3/projects/a7f9d08dadd24d78b125397d1904ae7d/users/b4a74d58f6974f58bf43496f6df8176e/roles/d783a633c75847d48ef7ef5b169b0313` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:03.172377 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1297c3a1-c496-4998-980c-dee7b4a935c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=a7f9d08dadd24d78b125397d1904ae7d, user_id=b4a74d58f6974f58bf43496f6df8176e, role_id=d783a633c75847d48ef7ef5b169b0313)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:03.178458 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1297c3a1-c496-4998-980c-dee7b4a935c5 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:03.199489 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 118/234] 10.222.0.20 () {58 vars in 1439 bytes} [Sat Jun 18 04:05:02 2022] PUT /identity/v3/projects/a7f9d08dadd24d78b125397d1904ae7d/users/b4a74d58f6974f58bf43496f6df8176e/roles/d783a633c75847d48ef7ef5b169b0313 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 04:05:03.978576 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792adfb-73af-4d9b-9d7d-1408fe2929c5 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:03.979586 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792adfb-73af-4d9b-9d7d-1408fe2929c5 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:03.980047 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792adfb-73af-4d9b-9d7d-1408fe2929c5 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:03.981958 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 117/235] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:05:03.987832 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ceb1f-28fa-4678-985d-8cf426e42f6c None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:03.988265 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ceb1f-28fa-4678-985d-8cf426e42f6c None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:03.988360 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ceb1f-28fa-4678-985d-8cf426e42f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:04.005603 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-801ceb1f-28fa-4678-985d-8cf426e42f6c None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:04.007095 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-801ceb1f-28fa-4678-985d-8cf426e42f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:04.070181 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d8f3a5-55ae-4ff8-a622-229d3a1f767f None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:04.070816 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d8f3a5-55ae-4ff8-a622-229d3a1f767f None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:04.071312 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d8f3a5-55ae-4ff8-a622-229d3a1f767f None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:04.073313 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 118/236] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:05:04.080970 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 119/237] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:05:04.082443 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c8522-c03d-419a-9bce-a9c0808ad363 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:04.082929 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c8522-c03d-419a-9bce-a9c0808ad363 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:04.083417 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c8522-c03d-419a-9bce-a9c0808ad363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:04.108780 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ceb1f-28fa-4678-985d-8cf426e42f6c None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:04.117663 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-282c8522-c03d-419a-9bce-a9c0808ad363 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:04.118877 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-282c8522-c03d-419a-9bce-a9c0808ad363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:04.213444 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ceb1f-28fa-4678-985d-8cf426e42f6c None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:04.224821 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:04.251971 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a7bb72-ef14-4783-9d7f-54384299aa94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:04.252827 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7bb72-ef14-4783-9d7f-54384299aa94 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:04.253223 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7bb72-ef14-4783-9d7f-54384299aa94 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:04.253502 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7bb72-ef14-4783-9d7f-54384299aa94 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:04.254702 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a7bb72-ef14-4783-9d7f-54384299aa94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:04.254922 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 119/238] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 18 04:05:04.256659 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a7bb72-ef14-4783-9d7f-54384299aa94 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:04.258341 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 120/239] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:05:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:04.264206 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282c8522-c03d-419a-9bce-a9c0808ad363 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:04.278485 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a7bb72-ef14-4783-9d7f-54384299aa94 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:04.383276 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a7bb72-ef14-4783-9d7f-54384299aa94 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:04.423196 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:04.425477 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c179682-28b4-489a-8075-ccf8676390d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:04.426457 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c179682-28b4-489a-8075-ccf8676390d8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:04.426898 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c179682-28b4-489a-8075-ccf8676390d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:04.427328 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c179682-28b4-489a-8075-ccf8676390d8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:04.441861 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c179682-28b4-489a-8075-ccf8676390d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:05:04.452473 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-3c179682-28b4-489a-8075-ccf8676390d8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 18 04:05:04.452473 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:04.452473 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:04.452473 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:04.452473 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:04.452473 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:04.452473 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:04.452473 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:04.452473 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:04.452473 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:04.452473 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:04.452473 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:04.452473 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:05:04.452473 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:05:04.452473 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:05:04.452473 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:05:04.453613 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:05:04.453613 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:05:04.453613 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:05:04.453613 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:05:04.453613 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:04.453613 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:04.453613 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:04.453613 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:04.453613 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:04.453613 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:04.453613 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:04.453613 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:04.453613 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:04.453613 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:04.453613 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:04.453613 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:04.454622 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:04.454622 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:04.454622 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:04.454622 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:04.454622 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:05:04.454622 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:05:04.454622 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:05:04.454622 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:05:04.454622 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:05:04.454622 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:05:04.454622 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 18 04:05:04.454622 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:04.457770 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 121/240] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Jun 18 04:05:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 04:05:04.459240 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282c8522-c03d-419a-9bce-a9c0808ad363 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:04.459364 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16406bb-681a-4217-8741-d25a8a24c60b None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:04.459765 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16406bb-681a-4217-8741-d25a8a24c60b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:04.460174 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16406bb-681a-4217-8741-d25a8a24c60b None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:04.462961 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 122/241] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:05:04.463893 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16406bb-681a-4217-8741-d25a8a24c60b None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:04.506551 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1187bb1-cde0-4c4a-ab39-f2ce5809b855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:04.507660 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1187bb1-cde0-4c4a-ab39-f2ce5809b855 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:04.508187 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1187bb1-cde0-4c4a-ab39-f2ce5809b855 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:04.508637 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1187bb1-cde0-4c4a-ab39-f2ce5809b855 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:04.509652 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1187bb1-cde0-4c4a-ab39-f2ce5809b855 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:04.512086 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1187bb1-cde0-4c4a-ab39-f2ce5809b855 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:04.525072 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:04.538042 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 120/242] 10.222.0.20 () {60 vars in 1132 bytes} [Sat Jun 18 04:05:04 2022] POST /identity/v3/users => generated 293 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 04:05:04.539939 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c456aa-6f0b-4324-bdc0-11cadc11c8ba None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:04.540358 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c456aa-6f0b-4324-bdc0-11cadc11c8ba None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:04.540828 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c456aa-6f0b-4324-bdc0-11cadc11c8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:04.560989 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-47c456aa-6f0b-4324-bdc0-11cadc11c8ba None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:04.562630 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-47c456aa-6f0b-4324-bdc0-11cadc11c8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:04.630062 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16406bb-681a-4217-8741-d25a8a24c60b None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:04.651081 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 121/243] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:05:04.678475 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c456aa-6f0b-4324-bdc0-11cadc11c8ba None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:04.714324 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b4a17-9208-4da2-b07b-e13532c0afb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:04.715022 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b4a17-9208-4da2-b07b-e13532c0afb4 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:04.715302 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b4a17-9208-4da2-b07b-e13532c0afb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:04.715577 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b4a17-9208-4da2-b07b-e13532c0afb4 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:04.716413 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b4a17-9208-4da2-b07b-e13532c0afb4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:04.716771 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b4a17-9208-4da2-b07b-e13532c0afb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:04.722638 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b4a17-9208-4da2-b07b-e13532c0afb4 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:04.742924 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 123/244] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Jun 18 04:05:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:04.746413 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b4a17-9208-4da2-b07b-e13532c0afb4 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:04.793256 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:04.842192 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c456aa-6f0b-4324-bdc0-11cadc11c8ba None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:04.879107 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d10a6b1-dbb7-4a9e-b91d-4e604b4ce2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:04.879919 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10a6b1-dbb7-4a9e-b91d-4e604b4ce2ae None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:04.880543 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10a6b1-dbb7-4a9e-b91d-4e604b4ce2ae None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:04.880698 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10a6b1-dbb7-4a9e-b91d-4e604b4ce2ae None admin] PATH_INFO: `/v3/roles/member` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:04.887484 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:04.890949 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b4a17-9208-4da2-b07b-e13532c0afb4 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:04.892808 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d10a6b1-dbb7-4a9e-b91d-4e604b4ce2ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:05:04.902802 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-9d10a6b1-dbb7-4a9e-b91d-4e604b4ce2ae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 18 04:05:04.902802 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:04.902802 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:04.902802 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:04.902802 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:04.902802 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:04.902802 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:04.902802 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:04.902802 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:04.902802 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:04.902802 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:04.902802 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:04.902802 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:05:04.902802 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:05:04.902802 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:05:04.902802 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:05:04.903736 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:05:04.903736 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:05:04.903736 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:05:04.903736 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:05:04.903736 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:04.903736 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:04.903736 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:04.903736 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:04.903736 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:04.903736 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:04.903736 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:04.903736 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:04.903736 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:04.903736 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:04.903736 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:04.903736 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:04.904937 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:04.904937 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:04.904937 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:04.904937 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:04.904937 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:05:04.904937 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:05:04.904937 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:05:04.904937 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:05:04.904937 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:05:04.904937 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:05:04.904937 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 18 04:05:04.904937 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:05:04.904937 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 122/245] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Jun 18 04:05:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 04:05:04.910310 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d10a6b1-dbb7-4a9e-b91d-4e604b4ce2ae None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:04.932767 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06c3ae-2b19-4578-8e41-7c3ddd5c3b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:04.933994 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06c3ae-2b19-4578-8e41-7c3ddd5c3b7c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:04.934546 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06c3ae-2b19-4578-8e41-7c3ddd5c3b7c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:04.935110 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06c3ae-2b19-4578-8e41-7c3ddd5c3b7c None admin] PATH_INFO: `/v3/users/cee306c8db5248a4a7ab99e4242aa3ec` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:04.950048 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb06c3ae-2b19-4578-8e41-7c3ddd5c3b7c None admin] RBAC: Authorizing `identity:get_user(user_id=cee306c8db5248a4a7ab99e4242aa3ec)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:04.951797 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb06c3ae-2b19-4578-8e41-7c3ddd5c3b7c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:04.954115 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 124/246] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Jun 18 04:05:04 2022] GET /identity/v3/users/cee306c8db5248a4a7ab99e4242aa3ec => generated 297 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:04.959132 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06c3ae-2b19-4578-8e41-7c3ddd5c3b7c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:05.024649 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d10a6b1-dbb7-4a9e-b91d-4e604b4ce2ae None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:05.040064 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:05.067029 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94450a5-028f-490e-b416-bc73b0a6beea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:05.068024 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94450a5-028f-490e-b416-bc73b0a6beea None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:05.068462 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94450a5-028f-490e-b416-bc73b0a6beea None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:05.068919 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94450a5-028f-490e-b416-bc73b0a6beea None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:05.069863 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94450a5-028f-490e-b416-bc73b0a6beea None admin] RBAC: Adding query filter params (name=member) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:05.070364 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94450a5-028f-490e-b416-bc73b0a6beea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:05.072124 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94450a5-028f-490e-b416-bc73b0a6beea None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:05.080906 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06c3ae-2b19-4578-8e41-7c3ddd5c3b7c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:05.082437 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 123/247] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Jun 18 04:05:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:05:05.087993 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94450a5-028f-490e-b416-bc73b0a6beea None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:05.119038 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd09fe8b-9f5f-4253-a082-fe991b9f4a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:05.119939 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09fe8b-9f5f-4253-a082-fe991b9f4a85 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:05.120470 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09fe8b-9f5f-4253-a082-fe991b9f4a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:05.121038 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09fe8b-9f5f-4253-a082-fe991b9f4a85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:05.150861 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:05.197626 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd09fe8b-9f5f-4253-a082-fe991b9f4a85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:05.199524 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd09fe8b-9f5f-4253-a082-fe991b9f4a85 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:05.200154 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94450a5-028f-490e-b416-bc73b0a6beea None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:05.240125 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49226ef-b46c-4e57-bb28-996c8be8e108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:05.241335 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49226ef-b46c-4e57-bb28-996c8be8e108 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:05.241789 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49226ef-b46c-4e57-bb28-996c8be8e108 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:05.242211 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49226ef-b46c-4e57-bb28-996c8be8e108 None admin] PATH_INFO: `/v3/users/300bf1ac59b447b58ba665fd2e02aa73` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:05.243884 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49226ef-b46c-4e57-bb28-996c8be8e108 None admin] RBAC: Authorizing `identity:get_user(user_id=300bf1ac59b447b58ba665fd2e02aa73)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:05.245818 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49226ef-b46c-4e57-bb28-996c8be8e108 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:05.247801 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 124/248] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Jun 18 04:05:05 2022] GET /identity/v3/users/300bf1ac59b447b58ba665fd2e02aa73 => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:05:05.253767 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49226ef-b46c-4e57-bb28-996c8be8e108 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:05.303109 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:05.312702 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 125/249] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Jun 18 04:05:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 18 04:05:05.319612 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd09fe8b-9f5f-4253-a082-fe991b9f4a85 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:05.372413 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49226ef-b46c-4e57-bb28-996c8be8e108 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:05.390968 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:05.411806 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed51e6-19ce-4fc4-91db-2d7f7ed02da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:05.413063 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed51e6-19ce-4fc4-91db-2d7f7ed02da7 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:05.413669 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed51e6-19ce-4fc4-91db-2d7f7ed02da7 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:05.414162 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed51e6-19ce-4fc4-91db-2d7f7ed02da7 None admin] PATH_INFO: `/v3/projects/a7f9d08dadd24d78b125397d1904ae7d` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:05.415714 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ed51e6-19ce-4fc4-91db-2d7f7ed02da7 None admin] RBAC: Authorizing `identity:get_project(project_id=a7f9d08dadd24d78b125397d1904ae7d)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:05.417491 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ed51e6-19ce-4fc4-91db-2d7f7ed02da7 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:05.420145 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 125/250] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Jun 18 04:05:05 2022] GET /identity/v3/projects/a7f9d08dadd24d78b125397d1904ae7d => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:05:05.426538 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed51e6-19ce-4fc4-91db-2d7f7ed02da7 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:05.439089 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd09fe8b-9f5f-4253-a082-fe991b9f4a85 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:05.477124 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e882c-3638-4fc1-90e4-7aad34295411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:05.478399 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e882c-3638-4fc1-90e4-7aad34295411 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:05.478857 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e882c-3638-4fc1-90e4-7aad34295411 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:05.479400 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e882c-3638-4fc1-90e4-7aad34295411 None admin] PATH_INFO: `/v3/projects/a7f9d08dadd24d78b125397d1904ae7d` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:05.480913 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53e882c-3638-4fc1-90e4-7aad34295411 None admin] RBAC: Authorizing `identity:get_project(project_id=a7f9d08dadd24d78b125397d1904ae7d)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:05.482832 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53e882c-3638-4fc1-90e4-7aad34295411 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:05.485613 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 126/251] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Jun 18 04:05:05 2022] GET /identity/v3/projects/a7f9d08dadd24d78b125397d1904ae7d => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:05.490898 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e882c-3638-4fc1-90e4-7aad34295411 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:05.542470 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed51e6-19ce-4fc4-91db-2d7f7ed02da7 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:05.555455 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:05.586989 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cb6da2-0322-431a-ad57-930f69b0d754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:05.588831 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb6da2-0322-431a-ad57-930f69b0d754 None admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:05.589262 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb6da2-0322-431a-ad57-930f69b0d754 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:05.589957 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb6da2-0322-431a-ad57-930f69b0d754 None admin] PATH_INFO: `/v3/projects/a7f9d08dadd24d78b125397d1904ae7d/users/300bf1ac59b447b58ba665fd2e02aa73/roles/d74f7ad64e584e6186564837fa3cf380` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:05.593333 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cb6da2-0322-431a-ad57-930f69b0d754 None admin] RBAC: Authorizing `identity:create_grant(project_id=a7f9d08dadd24d78b125397d1904ae7d, user_id=300bf1ac59b447b58ba665fd2e02aa73, role_id=d74f7ad64e584e6186564837fa3cf380)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:05.594971 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cb6da2-0322-431a-ad57-930f69b0d754 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:05.614400 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 126/252] 10.222.0.20 () {58 vars in 1439 bytes} [Sat Jun 18 04:05:05 2022] PUT /identity/v3/projects/a7f9d08dadd24d78b125397d1904ae7d/users/300bf1ac59b447b58ba665fd2e02aa73/roles/d74f7ad64e584e6186564837fa3cf380 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 04:05:05.635238 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e882c-3638-4fc1-90e4-7aad34295411 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:05.669960 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:05.680509 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c5b4e-a865-4838-bc28-90da1ff70bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:05.681410 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c5b4e-a865-4838-bc28-90da1ff70bef None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:05.681697 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c5b4e-a865-4838-bc28-90da1ff70bef None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:05.681965 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c5b4e-a865-4838-bc28-90da1ff70bef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:05.682892 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87c5b4e-a865-4838-bc28-90da1ff70bef None admin] RBAC: Adding query filter params (role.id=3af5984773ef41448b3d4ef5e617e090, scope.project.id=a7f9d08dadd24d78b125397d1904ae7d, user.id=cee306c8db5248a4a7ab99e4242aa3ec) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:05.683204 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87c5b4e-a865-4838-bc28-90da1ff70bef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:05.684840 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87c5b4e-a865-4838-bc28-90da1ff70bef None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:05.691801 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 127/253] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Jun 18 04:05:05 2022] GET /identity/v3/role_assignments?user.id=cee306c8db5248a4a7ab99e4242aa3ec&scope.project.id=a7f9d08dadd24d78b125397d1904ae7d&role.id=3af5984773ef41448b3d4ef5e617e090 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:05:05.749583 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577adc9-6650-4c7a-8390-38a763cea6da None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:05.749923 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577adc9-6650-4c7a-8390-38a763cea6da None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:05.750148 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577adc9-6650-4c7a-8390-38a763cea6da None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:05.752399 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 127/254] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:05:05.758038 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2422e3d-bc63-407a-840d-44751679242c None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:05.758359 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2422e3d-bc63-407a-840d-44751679242c None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:05.758591 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2422e3d-bc63-407a-840d-44751679242c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:05.783701 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-b2422e3d-bc63-407a-840d-44751679242c None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:05.784956 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b2422e3d-bc63-407a-840d-44751679242c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:05.869906 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 128/255] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:05:05.894201 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4577adc9-6650-4c7a-8390-38a763cea6da None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:05.956954 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7649f4f-fd77-4fbb-b87d-8d555de07cdc None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:05.957441 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7649f4f-fd77-4fbb-b87d-8d555de07cdc None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:05.957861 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7649f4f-fd77-4fbb-b87d-8d555de07cdc None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:05.959509 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 129/256] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:05:05.965526 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81cafb3-c73d-42e4-b231-c442e395350a None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:05.966167 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81cafb3-c73d-42e4-b231-c442e395350a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:05.966167 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81cafb3-c73d-42e4-b231-c442e395350a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:06.005705 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-b81cafb3-c73d-42e4-b231-c442e395350a None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:06.007379 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b81cafb3-c73d-42e4-b231-c442e395350a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:06.086260 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4577adc9-6650-4c7a-8390-38a763cea6da None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:06.095082 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 130/257] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:05:06.127181 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce1c3dc-fddc-41d0-b5b5-b457aee38578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:06.127928 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1c3dc-fddc-41d0-b5b5-b457aee38578 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:06.128208 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1c3dc-fddc-41d0-b5b5-b457aee38578 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:06.128479 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1c3dc-fddc-41d0-b5b5-b457aee38578 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:06.133774 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81cafb3-c73d-42e4-b231-c442e395350a None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:06.143123 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce1c3dc-fddc-41d0-b5b5-b457aee38578 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:05:06.151536 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-4ce1c3dc-fddc-41d0-b5b5-b457aee38578 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 18 04:05:06.151536 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:06.151536 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:06.151536 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:06.151536 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:06.151536 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:06.151536 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:06.151536 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:06.151536 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:06.151536 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:06.151536 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:06.151536 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:06.151536 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:05:06.151536 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:05:06.151536 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:05:06.151536 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:05:06.152447 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:05:06.152447 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:05:06.152447 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:05:06.152447 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:05:06.152447 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:06.152447 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:06.152447 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:06.152447 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:06.152447 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:06.152447 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:06.152447 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:06.152447 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:06.152447 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:06.152447 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:06.152447 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:06.152447 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:06.153887 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:06.153887 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:06.153887 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:06.153887 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:06.153887 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:05:06.153887 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:05:06.153887 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:05:06.153887 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:05:06.153887 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:05:06.153887 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:05:06.153887 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 18 04:05:06.153887 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:05:06.153887 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 128/258] 10.222.0.20 () {56 vars in 1114 bytes} [Sat Jun 18 04:05:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:06.165699 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce1c3dc-fddc-41d0-b5b5-b457aee38578 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:06.217708 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:06.247630 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:06.298849 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81cafb3-c73d-42e4-b231-c442e395350a None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:06.361060 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce1c3dc-fddc-41d0-b5b5-b457aee38578 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:06.405938 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d5f62-f4ee-4ffd-bd20-552371b31ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:06.406534 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d5f62-f4ee-4ffd-bd20-552371b31ad2 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:06.406813 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d5f62-f4ee-4ffd-bd20-552371b31ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:06.407085 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d5f62-f4ee-4ffd-bd20-552371b31ad2 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:06.407847 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523d5f62-f4ee-4ffd-bd20-552371b31ad2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:06.408150 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523d5f62-f4ee-4ffd-bd20-552371b31ad2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:06.409566 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523d5f62-f4ee-4ffd-bd20-552371b31ad2 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:06.424403 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 129/259] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Jun 18 04:05:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:06.429325 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bedc6b8-ba87-492c-978e-2ad590a2aef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:06.430159 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bedc6b8-ba87-492c-978e-2ad590a2aef1 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:06.430443 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bedc6b8-ba87-492c-978e-2ad590a2aef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:06.430713 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bedc6b8-ba87-492c-978e-2ad590a2aef1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:06.433053 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d5f62-f4ee-4ffd-bd20-552371b31ad2 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:06.450055 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bedc6b8-ba87-492c-978e-2ad590a2aef1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:05:06.472214 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-7bedc6b8-ba87-492c-978e-2ad590a2aef1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 04:05:06.472214 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:06.472214 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:06.472214 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:06.472214 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:06.472214 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:06.472214 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:06.472214 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:06.472214 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:06.472214 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:06.472214 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:06.472214 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:06.472214 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:05:06.472214 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:05:06.472214 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:05:06.472214 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:05:06.473213 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:05:06.473213 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:05:06.473213 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:05:06.473213 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:05:06.473213 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:06.473213 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:06.473213 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:06.473213 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:06.473213 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:06.473213 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:06.473213 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:06.473213 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:06.473213 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:06.473213 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:06.473213 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:06.473213 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:06.474002 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:06.474002 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:06.474002 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:06.474002 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:06.474002 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:05:06.474002 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:05:06.474002 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:05:06.474002 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:05:06.474002 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:05:06.474002 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:05:06.474002 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 04:05:06.474002 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:06.475228 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 131/260] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Jun 18 04:05:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:06.482394 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bedc6b8-ba87-492c-978e-2ad590a2aef1 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:06.560028 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:06.579307 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d5f62-f4ee-4ffd-bd20-552371b31ad2 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:06.640269 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bedc6b8-ba87-492c-978e-2ad590a2aef1 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:06.651279 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:06.657643 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7307e-20b2-4ac8-a16c-6e268d553ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:06.658799 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7307e-20b2-4ac8-a16c-6e268d553ebf None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:06.659331 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7307e-20b2-4ac8-a16c-6e268d553ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:06.659810 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7307e-20b2-4ac8-a16c-6e268d553ebf None admin] PATH_INFO: `/v3/users/b4a74d58f6974f58bf43496f6df8176e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:06.664943 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a7307e-20b2-4ac8-a16c-6e268d553ebf None admin] RBAC: Authorizing `identity:get_user(user_id=b4a74d58f6974f58bf43496f6df8176e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:06.666698 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a7307e-20b2-4ac8-a16c-6e268d553ebf None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:06.668980 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 130/261] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Jun 18 04:05:06 2022] GET /identity/v3/users/b4a74d58f6974f58bf43496f6df8176e => generated 283 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:05:06.677681 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7307e-20b2-4ac8-a16c-6e268d553ebf None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:06.688369 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc9ba3-98f6-49a5-9d02-9a2d03968d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:06.689091 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc9ba3-98f6-49a5-9d02-9a2d03968d6d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:06.689368 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc9ba3-98f6-49a5-9d02-9a2d03968d6d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:06.689636 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc9ba3-98f6-49a5-9d02-9a2d03968d6d None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:06.690404 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bc9ba3-98f6-49a5-9d02-9a2d03968d6d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:06.690708 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bc9ba3-98f6-49a5-9d02-9a2d03968d6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:06.692105 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bc9ba3-98f6-49a5-9d02-9a2d03968d6d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:06.707210 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 132/262] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Jun 18 04:05:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:06.713506 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc9ba3-98f6-49a5-9d02-9a2d03968d6d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:06.801729 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7307e-20b2-4ac8-a16c-6e268d553ebf None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:06.842816 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33221cc-231b-49d5-8c1c-6df3f503effa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:06.843827 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33221cc-231b-49d5-8c1c-6df3f503effa None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:06.844339 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33221cc-231b-49d5-8c1c-6df3f503effa None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:06.844817 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33221cc-231b-49d5-8c1c-6df3f503effa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:06.876490 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:06.965588 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33221cc-231b-49d5-8c1c-6df3f503effa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:06.967120 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33221cc-231b-49d5-8c1c-6df3f503effa None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:06.983828 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc9ba3-98f6-49a5-9d02-9a2d03968d6d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:07.067760 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1c56b-1a29-4175-badf-4eb47f3ce4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:07.068730 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1c56b-1a29-4175-badf-4eb47f3ce4c6 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:07.069006 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1c56b-1a29-4175-badf-4eb47f3ce4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:07.069275 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1c56b-1a29-4175-badf-4eb47f3ce4c6 None admin] PATH_INFO: `/v3/users/b4a74d58f6974f58bf43496f6df8176e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:07.071672 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c1c56b-1a29-4175-badf-4eb47f3ce4c6 None admin] RBAC: Authorizing `identity:get_user(user_id=b4a74d58f6974f58bf43496f6df8176e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:07.073334 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c1c56b-1a29-4175-badf-4eb47f3ce4c6 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:07.075156 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 133/263] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Jun 18 04:05:06 2022] GET /identity/v3/users/b4a74d58f6974f58bf43496f6df8176e => generated 283 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:05:07.081588 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1c56b-1a29-4175-badf-4eb47f3ce4c6 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:07.151945 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:07.176323 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 131/264] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Jun 18 04:05:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 04:05:07.181796 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33221cc-231b-49d5-8c1c-6df3f503effa None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:07.259525 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1c56b-1a29-4175-badf-4eb47f3ce4c6 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:07.295476 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2510c1-ee08-4683-87b8-6b25ad0b97a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:07.296132 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2510c1-ee08-4683-87b8-6b25ad0b97a8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:07.296408 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2510c1-ee08-4683-87b8-6b25ad0b97a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:07.296709 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2510c1-ee08-4683-87b8-6b25ad0b97a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:07.324756 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:07.371547 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2510c1-ee08-4683-87b8-6b25ad0b97a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:07.373079 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2510c1-ee08-4683-87b8-6b25ad0b97a8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:07.393987 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33221cc-231b-49d5-8c1c-6df3f503effa None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:07.426737 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:07.462152 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680cd3f-4489-4ed0-a6b3-1541b36cf768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:07.463034 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680cd3f-4489-4ed0-a6b3-1541b36cf768 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:07.463310 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680cd3f-4489-4ed0-a6b3-1541b36cf768 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:07.463667 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680cd3f-4489-4ed0-a6b3-1541b36cf768 None admin] PATH_INFO: `/v3/projects/a7f9d08dadd24d78b125397d1904ae7d` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:07.469288 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7680cd3f-4489-4ed0-a6b3-1541b36cf768 None admin] RBAC: Authorizing `identity:get_project(project_id=a7f9d08dadd24d78b125397d1904ae7d)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:07.470754 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7680cd3f-4489-4ed0-a6b3-1541b36cf768 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:07.472675 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 132/265] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Jun 18 04:05:07 2022] GET /identity/v3/projects/a7f9d08dadd24d78b125397d1904ae7d => generated 302 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:07.483022 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680cd3f-4489-4ed0-a6b3-1541b36cf768 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:07.527705 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 134/266] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Jun 18 04:05:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 04:05:07.533982 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2510c1-ee08-4683-87b8-6b25ad0b97a8 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:07.603569 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680cd3f-4489-4ed0-a6b3-1541b36cf768 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:07.631966 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:07.648844 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9211b8-d76c-452a-8d7c-7ceb747c16d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:07.649035 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9211b8-d76c-452a-8d7c-7ceb747c16d5 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:07.649319 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9211b8-d76c-452a-8d7c-7ceb747c16d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:07.649594 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9211b8-d76c-452a-8d7c-7ceb747c16d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:07.650438 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9211b8-d76c-452a-8d7c-7ceb747c16d5 None admin] RBAC: Adding query filter params (role.id=ba29217afc57483a90e90b287c480549, scope.project.id=a7f9d08dadd24d78b125397d1904ae7d, user.id=b4a74d58f6974f58bf43496f6df8176e) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:07.650778 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9211b8-d76c-452a-8d7c-7ceb747c16d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:07.652323 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9211b8-d76c-452a-8d7c-7ceb747c16d5 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:07.666013 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 133/267] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Jun 18 04:05:07 2022] GET /identity/v3/role_assignments?user.id=b4a74d58f6974f58bf43496f6df8176e&scope.project.id=a7f9d08dadd24d78b125397d1904ae7d&role.id=ba29217afc57483a90e90b287c480549 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:05:07.716024 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2510c1-ee08-4683-87b8-6b25ad0b97a8 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:07.765319 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062eca56-4461-4597-9576-b8a85dd942c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:07.766207 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062eca56-4461-4597-9576-b8a85dd942c7 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:07.766480 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062eca56-4461-4597-9576-b8a85dd942c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:07.766748 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062eca56-4461-4597-9576-b8a85dd942c7 None admin] PATH_INFO: `/v3/projects/a7f9d08dadd24d78b125397d1904ae7d` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:07.767993 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062eca56-4461-4597-9576-b8a85dd942c7 None admin] RBAC: Authorizing `identity:get_project(project_id=a7f9d08dadd24d78b125397d1904ae7d)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:07.769501 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062eca56-4461-4597-9576-b8a85dd942c7 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:07.771292 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 135/268] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Jun 18 04:05:07 2022] GET /identity/v3/projects/a7f9d08dadd24d78b125397d1904ae7d => generated 302 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:05:07.777643 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9211b8-d76c-452a-8d7c-7ceb747c16d5 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:07.897400 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9211b8-d76c-452a-8d7c-7ceb747c16d5 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:07.941797 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cabd38-520f-4a89-bdd0-5e5b654b8a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:07.942937 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cabd38-520f-4a89-bdd0-5e5b654b8a67 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:07.943411 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cabd38-520f-4a89-bdd0-5e5b654b8a67 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:07.943939 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cabd38-520f-4a89-bdd0-5e5b654b8a67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:07.945075 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cabd38-520f-4a89-bdd0-5e5b654b8a67 None admin] RBAC: Adding query filter params (role.id=d783a633c75847d48ef7ef5b169b0313, scope.project.id=a7f9d08dadd24d78b125397d1904ae7d, user.id=b4a74d58f6974f58bf43496f6df8176e) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:07.945579 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cabd38-520f-4a89-bdd0-5e5b654b8a67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:07.947228 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cabd38-520f-4a89-bdd0-5e5b654b8a67 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:07.970916 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 134/269] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Jun 18 04:05:07 2022] GET /identity/v3/role_assignments?user.id=b4a74d58f6974f58bf43496f6df8176e&scope.project.id=a7f9d08dadd24d78b125397d1904ae7d&role.id=d783a633c75847d48ef7ef5b169b0313 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:08.135770 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191791f-5207-4c88-88a7-d9eb530a4d7f None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:08.136053 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191791f-5207-4c88-88a7-d9eb530a4d7f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:08.136548 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191791f-5207-4c88-88a7-d9eb530a4d7f None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:08.138584 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 136/270] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:05:08.144169 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb1b7f-bd06-4fa9-9f08-91a44c49cceb None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:08.144505 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb1b7f-bd06-4fa9-9f08-91a44c49cceb None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:08.144723 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb1b7f-bd06-4fa9-9f08-91a44c49cceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:08.168025 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-d5eb1b7f-bd06-4fa9-9f08-91a44c49cceb None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:08.169160 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-d5eb1b7f-bd06-4fa9-9f08-91a44c49cceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:08.238370 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:08.259139 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 135/271] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:05:08.281977 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a191791f-5207-4c88-88a7-d9eb530a4d7f None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:08.294594 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:08.398989 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a191791f-5207-4c88-88a7-d9eb530a4d7f None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:08.443360 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03946daf-f58e-4130-aca0-3df59374b25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:08.444167 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03946daf-f58e-4130-aca0-3df59374b25a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:08.444440 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03946daf-f58e-4130-aca0-3df59374b25a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:08.444759 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03946daf-f58e-4130-aca0-3df59374b25a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:08.458050 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03946daf-f58e-4130-aca0-3df59374b25a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:05:08.465935 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee9b6f-b83b-400a-8ac8-fa9499eefea0 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:08.466097 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee9b6f-b83b-400a-8ac8-fa9499eefea0 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:08.466365 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee9b6f-b83b-400a-8ac8-fa9499eefea0 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:08.467914 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 136/272] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:05:08.469553 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-03946daf-f58e-4130-aca0-3df59374b25a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 18 04:05:08.469553 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:08.469553 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:08.469553 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:08.469553 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:08.469553 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:08.469553 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:08.469553 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:08.469553 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:08.469553 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:08.469553 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:08.469553 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:08.469553 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:05:08.469553 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:05:08.469553 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:05:08.469553 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:05:08.470404 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:05:08.470404 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:05:08.470404 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:05:08.470404 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:05:08.470404 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:08.470404 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:08.470404 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:08.470404 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:08.470404 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:08.470404 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:08.470404 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:08.470404 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:08.470404 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:08.470404 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:08.470404 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:08.470404 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:08.471567 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:08.471567 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:08.471567 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:08.471567 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:08.471567 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:05:08.471567 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:05:08.471567 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:05:08.471567 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:05:08.471567 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:05:08.471567 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:05:08.471567 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 18 04:05:08.471567 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:08.471567 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 137/273] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Jun 18 04:05:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:08.476378 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee9b6f-b83b-400a-8ac8-fa9499eefea0 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:08.477954 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49dbb6c-f1c2-4c61-9638-f183b7e39303 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:08.478237 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49dbb6c-f1c2-4c61-9638-f183b7e39303 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:08.478509 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49dbb6c-f1c2-4c61-9638-f183b7e39303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:08.497465 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-e49dbb6c-f1c2-4c61-9638-f183b7e39303 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:08.499054 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e49dbb6c-f1c2-4c61-9638-f183b7e39303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:08.574680 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:08.587516 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 138/274] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 18 04:05:08.611703 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49dbb6c-f1c2-4c61-9638-f183b7e39303 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:08.618497 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee9b6f-b83b-400a-8ac8-fa9499eefea0 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:08.653619 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae3840-0d9b-463a-9c21-ad5016c4d47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:08.654699 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae3840-0d9b-463a-9c21-ad5016c4d47c None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:08.655166 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae3840-0d9b-463a-9c21-ad5016c4d47c None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:08.655630 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae3840-0d9b-463a-9c21-ad5016c4d47c None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:08.656600 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae3840-0d9b-463a-9c21-ad5016c4d47c None admin] RBAC: Adding query filter params (name=member) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:08.657109 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae3840-0d9b-463a-9c21-ad5016c4d47c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:08.658664 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae3840-0d9b-463a-9c21-ad5016c4d47c None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:08.668159 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 137/275] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Jun 18 04:05:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:08.673585 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae3840-0d9b-463a-9c21-ad5016c4d47c None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:08.729120 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49dbb6c-f1c2-4c61-9638-f183b7e39303 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:08.729775 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:08.765629 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4bfcfb-36e9-40f0-8a32-83480df56549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:08.766678 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4bfcfb-36e9-40f0-8a32-83480df56549 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:08.766955 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4bfcfb-36e9-40f0-8a32-83480df56549 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:08.767225 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4bfcfb-36e9-40f0-8a32-83480df56549 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:08.768376 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4bfcfb-36e9-40f0-8a32-83480df56549 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:08.769867 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4bfcfb-36e9-40f0-8a32-83480df56549 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:08.771517 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 139/276] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:05:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:05:08.777192 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f900bf-43ce-48ad-99cf-8b25961c078b None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:08.777469 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f900bf-43ce-48ad-99cf-8b25961c078b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:08.777745 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f900bf-43ce-48ad-99cf-8b25961c078b None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:08.780686 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 140/277] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:05:08.780686 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f900bf-43ce-48ad-99cf-8b25961c078b None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:08.784851 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae3840-0d9b-463a-9c21-ad5016c4d47c None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:08.817831 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75764c3-22b6-42ab-89fa-1f15feb26255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:08.818708 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75764c3-22b6-42ab-89fa-1f15feb26255 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:08.818986 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75764c3-22b6-42ab-89fa-1f15feb26255 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:08.819254 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75764c3-22b6-42ab-89fa-1f15feb26255 None admin] PATH_INFO: `/v3/users/007123ec376644a69edbb913114cb61f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:08.832543 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75764c3-22b6-42ab-89fa-1f15feb26255 None admin] RBAC: Authorizing `identity:get_user(user_id=007123ec376644a69edbb913114cb61f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:08.834023 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75764c3-22b6-42ab-89fa-1f15feb26255 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:08.835704 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 138/278] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Jun 18 04:05:08 2022] GET /identity/v3/users/007123ec376644a69edbb913114cb61f => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:05:08.837848 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af39df7-2d81-4de4-95f6-7ad79b346887 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:08.838130 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af39df7-2d81-4de4-95f6-7ad79b346887 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:08.838403 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af39df7-2d81-4de4-95f6-7ad79b346887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:08.847877 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:08.854592 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-6af39df7-2d81-4de4-95f6-7ad79b346887 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:08.855769 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-6af39df7-2d81-4de4-95f6-7ad79b346887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:08.886139 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f900bf-43ce-48ad-99cf-8b25961c078b None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:08.919841 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6237d14-ab19-41f5-a60c-c5e3b1bbfec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:08.920504 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6237d14-ab19-41f5-a60c-c5e3b1bbfec4 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:08.920814 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6237d14-ab19-41f5-a60c-c5e3b1bbfec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:08.921087 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6237d14-ab19-41f5-a60c-c5e3b1bbfec4 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:08.921789 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6237d14-ab19-41f5-a60c-c5e3b1bbfec4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:08.923228 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6237d14-ab19-41f5-a60c-c5e3b1bbfec4 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:08.923313 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 139/279] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:05:08.924618 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ec856-919c-4f3e-a9ef-8a90340e94f3 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:08.924906 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ec856-919c-4f3e-a9ef-8a90340e94f3 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:08.925180 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ec856-919c-4f3e-a9ef-8a90340e94f3 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:08.926612 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 140/280] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:05:08.927417 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ec856-919c-4f3e-a9ef-8a90340e94f3 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:08.947994 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 141/281] 10.222.0.20 () {60 vars in 1132 bytes} [Sat Jun 18 04:05:08 2022] POST /identity/v3/users => generated 293 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 04:05:08.949166 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04062e-eb34-4815-af2b-d7c142b3f668 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:08.949451 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04062e-eb34-4815-af2b-d7c142b3f668 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:08.949723 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04062e-eb34-4815-af2b-d7c142b3f668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:08.967705 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-7c04062e-eb34-4815-af2b-d7c142b3f668 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:08.968969 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-7c04062e-eb34-4815-af2b-d7c142b3f668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:08.982788 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:09.049957 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 142/282] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:05:09.050650 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04062e-eb34-4815-af2b-d7c142b3f668 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:09.078871 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ec856-919c-4f3e-a9ef-8a90340e94f3 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:09.118058 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30893a81-0d5f-452a-8b33-a1bedcaa95d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:09.118710 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30893a81-0d5f-452a-8b33-a1bedcaa95d1 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:09.118985 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30893a81-0d5f-452a-8b33-a1bedcaa95d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:09.119251 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30893a81-0d5f-452a-8b33-a1bedcaa95d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:09.120154 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30893a81-0d5f-452a-8b33-a1bedcaa95d1 None admin] RBAC: Adding query filter params (role.id=d74f7ad64e584e6186564837fa3cf380, user.id=007123ec376644a69edbb913114cb61f, scope.system=all) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:09.120457 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30893a81-0d5f-452a-8b33-a1bedcaa95d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:09.122530 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30893a81-0d5f-452a-8b33-a1bedcaa95d1 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:09.125112 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:09.136605 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 141/283] 10.222.0.20 () {56 vars in 1308 bytes} [Sat Jun 18 04:05:08 2022] GET /identity/v3/role_assignments?user.id=007123ec376644a69edbb913114cb61f&scope.system=all&role.id=d74f7ad64e584e6186564837fa3cf380 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:09.136605 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30893a81-0d5f-452a-8b33-a1bedcaa95d1 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:09.195019 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04062e-eb34-4815-af2b-d7c142b3f668 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:09.243812 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e29c7c-5964-49ac-8cc6-6bcb23b60b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:09.245510 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e29c7c-5964-49ac-8cc6-6bcb23b60b46 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:09.245510 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e29c7c-5964-49ac-8cc6-6bcb23b60b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:09.245510 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e29c7c-5964-49ac-8cc6-6bcb23b60b46 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:09.267115 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e29c7c-5964-49ac-8cc6-6bcb23b60b46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:05:09.272447 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:09.277125 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30893a81-0d5f-452a-8b33-a1bedcaa95d1 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:09.277356 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-58e29c7c-5964-49ac-8cc6-6bcb23b60b46 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 18 04:05:09.277356 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:09.277356 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:09.277356 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:09.277356 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:09.277356 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:09.277356 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:09.277356 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:09.277356 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:09.277356 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:09.277356 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:09.277356 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:09.277356 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:05:09.277356 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:05:09.277356 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:05:09.277356 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:05:09.278441 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:05:09.278441 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:05:09.278441 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:05:09.278441 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:05:09.278441 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:09.278441 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:09.278441 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:09.278441 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:09.278441 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:09.278441 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:09.278441 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:09.278441 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:09.278441 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:09.278441 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:09.278441 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:09.278441 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:09.279220 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:09.279220 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:09.279220 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:09.279220 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:09.279220 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:05:09.279220 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:05:09.279220 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:05:09.279220 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:05:09.279220 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:05:09.279220 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:05:09.279220 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 18 04:05:09.279220 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:09.279220 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 143/284] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Jun 18 04:05:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:09.286002 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e29c7c-5964-49ac-8cc6-6bcb23b60b46 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:09.327146 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa253554-7951-42e0-86d0-95f1055aa673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:09.328287 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa253554-7951-42e0-86d0-95f1055aa673 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:09.328797 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa253554-7951-42e0-86d0-95f1055aa673 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:09.329194 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa253554-7951-42e0-86d0-95f1055aa673 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:09.351155 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa253554-7951-42e0-86d0-95f1055aa673 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:05:09.362123 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-fa253554-7951-42e0-86d0-95f1055aa673 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 18 04:05:09.362123 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:09.362123 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:09.362123 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:09.362123 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:09.362123 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:09.362123 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:09.362123 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:09.362123 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:09.362123 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:09.362123 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:09.362123 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:09.362123 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:05:09.362123 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:05:09.362123 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:05:09.362123 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:05:09.363009 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:05:09.363009 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:05:09.363009 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:05:09.363009 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:05:09.363009 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:09.363009 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:09.363009 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:09.363009 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:09.363009 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:09.363009 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:09.363009 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:09.363009 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:09.363009 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:09.363009 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:09.363009 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:09.363009 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:09.363802 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:09.363802 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:09.363802 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:09.363802 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:09.363802 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:05:09.363802 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:05:09.363802 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:05:09.363802 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:05:09.363802 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:05:09.363802 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:05:09.363802 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 18 04:05:09.363802 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:05:09.363802 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 142/285] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Jun 18 04:05:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:09.370976 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa253554-7951-42e0-86d0-95f1055aa673 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:09.422702 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e29c7c-5964-49ac-8cc6-6bcb23b60b46 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:09.439857 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:09.469386 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef51f7-aac1-44fd-98e4-607c059b61df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:09.470072 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef51f7-aac1-44fd-98e4-607c059b61df None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:09.470347 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef51f7-aac1-44fd-98e4-607c059b61df None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:09.470618 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef51f7-aac1-44fd-98e4-607c059b61df None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:09.471381 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef51f7-aac1-44fd-98e4-607c059b61df None admin] RBAC: Adding query filter params (name=reader) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:09.471685 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef51f7-aac1-44fd-98e4-607c059b61df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:09.473132 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef51f7-aac1-44fd-98e4-607c059b61df None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:09.483285 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 144/286] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Jun 18 04:05:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:05:09.490513 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef51f7-aac1-44fd-98e4-607c059b61df None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:09.502615 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa253554-7951-42e0-86d0-95f1055aa673 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:09.544841 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d820c-9082-4b21-a942-8036cfb2991c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:09.545516 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d820c-9082-4b21-a942-8036cfb2991c None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:09.545790 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d820c-9082-4b21-a942-8036cfb2991c None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:09.546059 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d820c-9082-4b21-a942-8036cfb2991c None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:09.546816 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236d820c-9082-4b21-a942-8036cfb2991c None admin] RBAC: Adding query filter params (name=member) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:09.547212 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236d820c-9082-4b21-a942-8036cfb2991c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:09.548630 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236d820c-9082-4b21-a942-8036cfb2991c None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:09.558090 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 143/287] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Jun 18 04:05:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:09.565495 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d820c-9082-4b21-a942-8036cfb2991c None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:09.592721 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:09.596303 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef51f7-aac1-44fd-98e4-607c059b61df None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:09.641579 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01791fc4-5d7d-4180-93e2-def53abbeb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:09.642353 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01791fc4-5d7d-4180-93e2-def53abbeb53 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:09.642631 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01791fc4-5d7d-4180-93e2-def53abbeb53 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:09.642899 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01791fc4-5d7d-4180-93e2-def53abbeb53 None admin] PATH_INFO: `/v3/users/cee306c8db5248a4a7ab99e4242aa3ec` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:09.644156 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01791fc4-5d7d-4180-93e2-def53abbeb53 None admin] RBAC: Authorizing `identity:get_user(user_id=cee306c8db5248a4a7ab99e4242aa3ec)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:09.645668 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01791fc4-5d7d-4180-93e2-def53abbeb53 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:09.647900 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 145/288] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Jun 18 04:05:09 2022] GET /identity/v3/users/cee306c8db5248a4a7ab99e4242aa3ec => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:09.657284 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01791fc4-5d7d-4180-93e2-def53abbeb53 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:09.678760 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d820c-9082-4b21-a942-8036cfb2991c None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:09.714379 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa72ab04-1f93-45ad-9963-4549d0bd94be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:09.715618 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72ab04-1f93-45ad-9963-4549d0bd94be None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:09.716132 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72ab04-1f93-45ad-9963-4549d0bd94be None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:09.724771 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72ab04-1f93-45ad-9963-4549d0bd94be None admin] PATH_INFO: `/v3/users/300bf1ac59b447b58ba665fd2e02aa73` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:09.726489 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa72ab04-1f93-45ad-9963-4549d0bd94be None admin] RBAC: Authorizing `identity:get_user(user_id=300bf1ac59b447b58ba665fd2e02aa73)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:09.728270 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa72ab04-1f93-45ad-9963-4549d0bd94be None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:09.729683 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:09.731387 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 144/289] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Jun 18 04:05:09 2022] GET /identity/v3/users/300bf1ac59b447b58ba665fd2e02aa73 => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:09.737332 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa72ab04-1f93-45ad-9963-4549d0bd94be None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:09.832901 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01791fc4-5d7d-4180-93e2-def53abbeb53 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:09.842941 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa72ab04-1f93-45ad-9963-4549d0bd94be None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:09.844903 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:09.886674 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725284d5-6516-4833-8a0a-908f4bb2d4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:09.887679 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725284d5-6516-4833-8a0a-908f4bb2d4ee None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:09.888147 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725284d5-6516-4833-8a0a-908f4bb2d4ee None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:09.888657 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725284d5-6516-4833-8a0a-908f4bb2d4ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:09.908400 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7974e78e-5177-4fb3-9214-1e19d5e21bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:09.909310 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974e78e-5177-4fb3-9214-1e19d5e21bee None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:09.909581 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974e78e-5177-4fb3-9214-1e19d5e21bee None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:09.909846 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974e78e-5177-4fb3-9214-1e19d5e21bee None admin] PATH_INFO: `/v3/projects/a7f9d08dadd24d78b125397d1904ae7d` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:09.911029 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7974e78e-5177-4fb3-9214-1e19d5e21bee None admin] RBAC: Authorizing `identity:get_project(project_id=a7f9d08dadd24d78b125397d1904ae7d)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:09.912493 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7974e78e-5177-4fb3-9214-1e19d5e21bee None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:09.922781 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 146/290] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Jun 18 04:05:09 2022] GET /identity/v3/projects/a7f9d08dadd24d78b125397d1904ae7d => generated 302 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:05:09.933552 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7974e78e-5177-4fb3-9214-1e19d5e21bee None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:09.964138 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725284d5-6516-4833-8a0a-908f4bb2d4ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:09.966652 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725284d5-6516-4833-8a0a-908f4bb2d4ee None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:10.056928 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:10.073120 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 145/291] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Jun 18 04:05:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 18 04:05:10.081759 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725284d5-6516-4833-8a0a-908f4bb2d4ee None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:10.195295 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7974e78e-5177-4fb3-9214-1e19d5e21bee None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:10.220917 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:10.255620 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725284d5-6516-4833-8a0a-908f4bb2d4ee None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:10.262162 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1920ef-5660-47ee-82d7-b357fec7fb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:10.263056 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1920ef-5660-47ee-82d7-b357fec7fb10 None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:10.263325 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1920ef-5660-47ee-82d7-b357fec7fb10 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:10.263585 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1920ef-5660-47ee-82d7-b357fec7fb10 None admin] PATH_INFO: `/v3/projects/a7f9d08dadd24d78b125397d1904ae7d/users/cee306c8db5248a4a7ab99e4242aa3ec/roles/3af5984773ef41448b3d4ef5e617e090` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:10.265567 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1920ef-5660-47ee-82d7-b357fec7fb10 None admin] RBAC: Authorizing `identity:create_grant(project_id=a7f9d08dadd24d78b125397d1904ae7d, user_id=cee306c8db5248a4a7ab99e4242aa3ec, role_id=3af5984773ef41448b3d4ef5e617e090)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:10.267023 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1920ef-5660-47ee-82d7-b357fec7fb10 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:10.292613 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad9119-36e5-4318-874e-6ba4a9a645c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:10.294145 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad9119-36e5-4318-874e-6ba4a9a645c8 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:10.294649 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad9119-36e5-4318-874e-6ba4a9a645c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:10.295169 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad9119-36e5-4318-874e-6ba4a9a645c8 None admin] PATH_INFO: `/v3/projects/a7f9d08dadd24d78b125397d1904ae7d` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:10.296669 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ad9119-36e5-4318-874e-6ba4a9a645c8 None admin] RBAC: Authorizing `identity:get_project(project_id=a7f9d08dadd24d78b125397d1904ae7d)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:10.298443 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ad9119-36e5-4318-874e-6ba4a9a645c8 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:10.304613 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 147/292] 10.222.0.20 () {58 vars in 1439 bytes} [Sat Jun 18 04:05:09 2022] PUT /identity/v3/projects/a7f9d08dadd24d78b125397d1904ae7d/users/cee306c8db5248a4a7ab99e4242aa3ec/roles/3af5984773ef41448b3d4ef5e617e090 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 04:05:10.305538 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 146/293] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Jun 18 04:05:10 2022] GET /identity/v3/projects/a7f9d08dadd24d78b125397d1904ae7d => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:10.314743 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1920ef-5660-47ee-82d7-b357fec7fb10 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:10.438566 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1920ef-5660-47ee-82d7-b357fec7fb10 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:10.483942 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b3eb9-080c-4a1c-87d1-50956458e8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:10.484923 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b3eb9-080c-4a1c-87d1-50956458e8aa None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:10.485205 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b3eb9-080c-4a1c-87d1-50956458e8aa None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:10.485474 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b3eb9-080c-4a1c-87d1-50956458e8aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:10.486344 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b3eb9-080c-4a1c-87d1-50956458e8aa None admin] RBAC: Adding query filter params (role.id=d74f7ad64e584e6186564837fa3cf380, scope.project.id=a7f9d08dadd24d78b125397d1904ae7d, user.id=300bf1ac59b447b58ba665fd2e02aa73) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:10.486655 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b3eb9-080c-4a1c-87d1-50956458e8aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:10.488176 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b3eb9-080c-4a1c-87d1-50956458e8aa None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:10.495864 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 148/294] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Jun 18 04:05:10 2022] GET /identity/v3/role_assignments?user.id=300bf1ac59b447b58ba665fd2e02aa73&scope.project.id=a7f9d08dadd24d78b125397d1904ae7d&role.id=d74f7ad64e584e6186564837fa3cf380 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:11.292637 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff822d6-3537-4a3f-90c1-4aa190ba4fce None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:11.293135 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff822d6-3537-4a3f-90c1-4aa190ba4fce None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:11.293135 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff822d6-3537-4a3f-90c1-4aa190ba4fce None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:11.294736 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 147/295] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:05:11.300076 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77390d38-509c-47ad-9c09-ac256112d3da None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:11.300646 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77390d38-509c-47ad-9c09-ac256112d3da None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:11.301121 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77390d38-509c-47ad-9c09-ac256112d3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:11.318475 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-77390d38-509c-47ad-9c09-ac256112d3da None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:11.320443 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-77390d38-509c-47ad-9c09-ac256112d3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:11.347713 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:11.389232 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 149/296] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:05:11.412409 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff822d6-3537-4a3f-90c1-4aa190ba4fce None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:11.468380 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5343c0f-b0c7-4a99-a79b-86d62fdaeb1e None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:11.468696 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5343c0f-b0c7-4a99-a79b-86d62fdaeb1e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:11.468975 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5343c0f-b0c7-4a99-a79b-86d62fdaeb1e None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:11.470372 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 150/297] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:05:11.476873 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65abdf39-37c4-4027-893a-431caff0925c None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:11.477364 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65abdf39-37c4-4027-893a-431caff0925c None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:11.477827 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65abdf39-37c4-4027-893a-431caff0925c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:11.487079 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:11.495911 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-65abdf39-37c4-4027-893a-431caff0925c None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:11.497468 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-65abdf39-37c4-4027-893a-431caff0925c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:11.540090 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff822d6-3537-4a3f-90c1-4aa190ba4fce None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:11.581968 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 151/298] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:05:11.583795 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f2213-222e-42bd-b067-7242b3afefd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:11.584664 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f2213-222e-42bd-b067-7242b3afefd1 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:11.585091 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f2213-222e-42bd-b067-7242b3afefd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:11.585481 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f2213-222e-42bd-b067-7242b3afefd1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:11.599796 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1f2213-222e-42bd-b067-7242b3afefd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:05:11.604028 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65abdf39-37c4-4027-893a-431caff0925c None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:11.610466 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-6f1f2213-222e-42bd-b067-7242b3afefd1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 18 04:05:11.610466 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:11.610466 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:11.610466 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:11.610466 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:11.610466 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:11.610466 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:11.610466 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:11.610466 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:11.610466 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:11.610466 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:11.610466 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:11.610466 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:05:11.610466 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:05:11.610466 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:05:11.610466 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:05:11.611421 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:05:11.611421 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:05:11.611421 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:05:11.611421 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:05:11.611421 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:11.611421 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:11.611421 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:11.611421 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:11.611421 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:11.611421 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:11.611421 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:11.611421 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:11.611421 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:11.611421 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:11.611421 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:11.611421 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:11.612221 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:11.612221 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:11.612221 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:11.612221 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:11.612221 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:05:11.612221 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:05:11.612221 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:05:11.612221 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:05:11.612221 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:05:11.612221 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:05:11.612221 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 18 04:05:11.612221 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:05:11.612866 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 148/299] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Jun 18 04:05:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:11.617517 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f2213-222e-42bd-b067-7242b3afefd1 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:11.716857 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:11.726245 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65abdf39-37c4-4027-893a-431caff0925c None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:11.727665 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f2213-222e-42bd-b067-7242b3afefd1 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:11.746253 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:11.764850 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d4f59f-7e26-4cbb-9c76-e89501d34b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:11.765517 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4f59f-7e26-4cbb-9c76-e89501d34b89 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:11.765792 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4f59f-7e26-4cbb-9c76-e89501d34b89 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:11.766060 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4f59f-7e26-4cbb-9c76-e89501d34b89 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:11.766800 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d4f59f-7e26-4cbb-9c76-e89501d34b89 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:11.767097 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d4f59f-7e26-4cbb-9c76-e89501d34b89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:11.767705 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5f4a63-1bd9-4097-a15e-0903688d4157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:11.768512 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f4a63-1bd9-4097-a15e-0903688d4157 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:11.768683 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d4f59f-7e26-4cbb-9c76-e89501d34b89 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:11.768814 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f4a63-1bd9-4097-a15e-0903688d4157 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:11.769240 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f4a63-1bd9-4097-a15e-0903688d4157 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:11.781642 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 149/300] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Jun 18 04:05:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:05:11.781642 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361c47c-46d7-4146-9c82-6110308ae3a0 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:11.781642 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361c47c-46d7-4146-9c82-6110308ae3a0 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:11.781642 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361c47c-46d7-4146-9c82-6110308ae3a0 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:11.781642 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 150/301] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:05:11.782560 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0361c47c-46d7-4146-9c82-6110308ae3a0 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:11.785553 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5f4a63-1bd9-4097-a15e-0903688d4157 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:05:11.793411 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-ce5f4a63-1bd9-4097-a15e-0903688d4157 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 18 04:05:11.793411 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:11.793411 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:11.793411 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:11.793411 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:11.793411 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:11.793411 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:11.793411 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:11.793411 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:11.793411 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:11.793411 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:11.793411 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:11.793411 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:05:11.793411 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:05:11.793411 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:05:11.793411 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:05:11.794275 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:05:11.794275 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:05:11.794275 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:05:11.794275 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:05:11.794275 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:11.794275 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:11.794275 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:11.794275 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:11.794275 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:11.794275 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:11.794275 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:11.794275 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:11.794275 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:11.794275 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:11.794275 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:11.794275 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:11.800772 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:11.800772 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:11.800772 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:11.800772 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:11.800772 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:05:11.800772 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:05:11.800772 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:05:11.800772 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:05:11.800772 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:05:11.800772 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:05:11.800772 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 18 04:05:11.800772 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:11.800772 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 152/302] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Jun 18 04:05:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 04:05:11.800772 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648ee1d-7eba-4d39-8ff6-569fac118cc2 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:11.801526 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648ee1d-7eba-4d39-8ff6-569fac118cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:11.801526 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648ee1d-7eba-4d39-8ff6-569fac118cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:11.813536 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-1648ee1d-7eba-4d39-8ff6-569fac118cc2 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:11.814947 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-1648ee1d-7eba-4d39-8ff6-569fac118cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:11.888639 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 153/303] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:05:11.889759 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648ee1d-7eba-4d39-8ff6-569fac118cc2 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:11.900230 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0361c47c-46d7-4146-9c82-6110308ae3a0 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:11.937717 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3328b5b9-7fdf-4adf-81ad-4ba7e44521f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:11.938599 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328b5b9-7fdf-4adf-81ad-4ba7e44521f4 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:11.938879 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328b5b9-7fdf-4adf-81ad-4ba7e44521f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:11.939139 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328b5b9-7fdf-4adf-81ad-4ba7e44521f4 None admin] PATH_INFO: `/v3/users/c1c470f76a6a48d298bb5cb96df9458e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:11.952813 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3328b5b9-7fdf-4adf-81ad-4ba7e44521f4 None admin] RBAC: Authorizing `identity:get_user(user_id=c1c470f76a6a48d298bb5cb96df9458e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:11.954261 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3328b5b9-7fdf-4adf-81ad-4ba7e44521f4 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:11.956358 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 151/304] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Jun 18 04:05:11 2022] GET /identity/v3/users/c1c470f76a6a48d298bb5cb96df9458e => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:11.963280 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3328b5b9-7fdf-4adf-81ad-4ba7e44521f4 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:11.982735 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:11.999361 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648ee1d-7eba-4d39-8ff6-569fac118cc2 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:12.004494 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:12.036324 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8859561d-dd1d-4045-918f-16fe76443fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:12.037512 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859561d-dd1d-4045-918f-16fe76443fcf None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:12.038769 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859561d-dd1d-4045-918f-16fe76443fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:12.039188 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859561d-dd1d-4045-918f-16fe76443fcf None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:12.040089 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8859561d-dd1d-4045-918f-16fe76443fcf None admin] RBAC: Adding query filter params (name=member) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:12.040534 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8859561d-dd1d-4045-918f-16fe76443fcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:12.042140 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8859561d-dd1d-4045-918f-16fe76443fcf None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:12.056034 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 154/305] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Jun 18 04:05:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:12.056034 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8859561d-dd1d-4045-918f-16fe76443fcf None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:12.071387 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3328b5b9-7fdf-4adf-81ad-4ba7e44521f4 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:12.106155 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121e740-8b9a-4b35-bc9c-8d317039b3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:12.106943 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121e740-8b9a-4b35-bc9c-8d317039b3c6 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:12.107228 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121e740-8b9a-4b35-bc9c-8d317039b3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:12.107510 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121e740-8b9a-4b35-bc9c-8d317039b3c6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:12.108670 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4121e740-8b9a-4b35-bc9c-8d317039b3c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:12.110474 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4121e740-8b9a-4b35-bc9c-8d317039b3c6 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:12.112108 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 152/306] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:05:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:12.117433 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121e740-8b9a-4b35-bc9c-8d317039b3c6 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:12.163786 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8859561d-dd1d-4045-918f-16fe76443fcf None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:12.198181 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510fd50-b465-4c5e-8a45-5275c339264b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:12.198832 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510fd50-b465-4c5e-8a45-5275c339264b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:12.199107 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510fd50-b465-4c5e-8a45-5275c339264b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:12.199373 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510fd50-b465-4c5e-8a45-5275c339264b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:12.200200 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9510fd50-b465-4c5e-8a45-5275c339264b None admin] RBAC: Adding query filter params (role.id=3af5984773ef41448b3d4ef5e617e090, user.id=c1c470f76a6a48d298bb5cb96df9458e, scope.system=all) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:12.200610 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9510fd50-b465-4c5e-8a45-5275c339264b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:12.201978 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9510fd50-b465-4c5e-8a45-5275c339264b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:12.207282 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 155/307] 10.222.0.20 () {56 vars in 1308 bytes} [Sat Jun 18 04:05:12 2022] GET /identity/v3/role_assignments?user.id=c1c470f76a6a48d298bb5cb96df9458e&scope.system=all&role.id=3af5984773ef41448b3d4ef5e617e090 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:12.212879 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510fd50-b465-4c5e-8a45-5275c339264b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:12.233563 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:12.235393 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121e740-8b9a-4b35-bc9c-8d317039b3c6 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:12.247770 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:12.277703 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc80f49f-df2d-40ce-bf21-90ba3a9c73ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:12.278601 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc80f49f-df2d-40ce-bf21-90ba3a9c73ad None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:12.278877 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc80f49f-df2d-40ce-bf21-90ba3a9c73ad None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:12.279146 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc80f49f-df2d-40ce-bf21-90ba3a9c73ad None admin] PATH_INFO: `/v3/users/007123ec376644a69edbb913114cb61f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:12.280526 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc80f49f-df2d-40ce-bf21-90ba3a9c73ad None admin] RBAC: Authorizing `identity:get_user(user_id=007123ec376644a69edbb913114cb61f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:12.282172 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc80f49f-df2d-40ce-bf21-90ba3a9c73ad None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:12.284375 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 153/308] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Jun 18 04:05:12 2022] GET /identity/v3/users/007123ec376644a69edbb913114cb61f => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:12.293664 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc80f49f-df2d-40ce-bf21-90ba3a9c73ad None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:12.348192 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510fd50-b465-4c5e-8a45-5275c339264b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:12.388190 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f885fdb-52b0-423d-bd7a-766a3685783e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:12.388909 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f885fdb-52b0-423d-bd7a-766a3685783e None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:12.389348 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f885fdb-52b0-423d-bd7a-766a3685783e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:12.389627 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f885fdb-52b0-423d-bd7a-766a3685783e None admin] PATH_INFO: `/v3/groups` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:12.390446 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f885fdb-52b0-423d-bd7a-766a3685783e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:12.391906 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f885fdb-52b0-423d-bd7a-766a3685783e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:12.408667 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc80f49f-df2d-40ce-bf21-90ba3a9c73ad None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:12.410169 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 156/309] 10.222.0.20 () {60 vars in 1134 bytes} [Sat Jun 18 04:05:12 2022] POST /identity/v3/groups => generated 229 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 04:05:12.451583 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d3e2f-7b74-4330-8860-b5b483b23cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:12.452477 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d3e2f-7b74-4330-8860-b5b483b23cd3 None admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:12.452781 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d3e2f-7b74-4330-8860-b5b483b23cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:12.453050 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d3e2f-7b74-4330-8860-b5b483b23cd3 None admin] PATH_INFO: `/v3/system/users/007123ec376644a69edbb913114cb61f/roles/d74f7ad64e584e6186564837fa3cf380` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:12.454613 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5d3e2f-7b74-4330-8860-b5b483b23cd3 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=007123ec376644a69edbb913114cb61f, role_id=d74f7ad64e584e6186564837fa3cf380)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:12.456137 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5d3e2f-7b74-4330-8860-b5b483b23cd3 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:12.468183 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 154/310] 10.222.0.20 () {58 vars in 1334 bytes} [Sat Jun 18 04:05:12 2022] PUT /identity/v3/system/users/007123ec376644a69edbb913114cb61f/roles/d74f7ad64e584e6186564837fa3cf380 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 04:05:12.625604 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29940080-d570-41be-b74f-18dccb4ba5d5 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:12.625934 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29940080-d570-41be-b74f-18dccb4ba5d5 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:12.626156 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29940080-d570-41be-b74f-18dccb4ba5d5 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:12.627868 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 157/311] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:05:12.633728 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b7a79-b248-4f3d-8e2a-2fe74d3dbee1 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:12.634008 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b7a79-b248-4f3d-8e2a-2fe74d3dbee1 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:12.634277 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b7a79-b248-4f3d-8e2a-2fe74d3dbee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:12.652860 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-4f1b7a79-b248-4f3d-8e2a-2fe74d3dbee1 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:12.654057 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-4f1b7a79-b248-4f3d-8e2a-2fe74d3dbee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:12.685464 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:12.726969 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 155/312] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:05:12.750799 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29940080-d570-41be-b74f-18dccb4ba5d5 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:12.823102 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:12.855430 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29940080-d570-41be-b74f-18dccb4ba5d5 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:12.889916 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c09276a-15b4-4b09-a7e0-4ab8d8781a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:12.890713 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09276a-15b4-4b09-a7e0-4ab8d8781a67 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:12.890991 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09276a-15b4-4b09-a7e0-4ab8d8781a67 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:12.891254 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09276a-15b4-4b09-a7e0-4ab8d8781a67 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:12.901825 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c09276a-15b4-4b09-a7e0-4ab8d8781a67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:05:12.909507 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-9c09276a-15b4-4b09-a7e0-4ab8d8781a67 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 18 04:05:12.909507 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:12.909507 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:12.909507 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:12.909507 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:12.909507 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:12.909507 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:12.909507 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:12.909507 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:12.909507 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:12.909507 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:12.909507 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:12.909507 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:05:12.909507 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:05:12.909507 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:05:12.909507 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:05:12.910375 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:05:12.910375 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:05:12.910375 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:05:12.910375 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:05:12.910375 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:12.910375 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:12.910375 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:12.910375 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:12.910375 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:12.910375 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:12.910375 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:12.910375 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:12.910375 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:12.910375 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:12.910375 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:12.910375 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:12.911153 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:12.911153 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:12.911153 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:12.911153 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:12.911153 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:05:12.911153 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:05:12.911153 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:05:12.911153 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:05:12.911153 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:05:12.911153 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:05:12.911153 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 18 04:05:12.911153 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:12.911153 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 158/313] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Jun 18 04:05:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:12.916803 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b7a79-b248-4f3d-8e2a-2fe74d3dbee1 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:13.026732 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b7a79-b248-4f3d-8e2a-2fe74d3dbee1 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:13.061409 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5581b7-bf74-4a22-b346-59d362164c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:13.062086 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5581b7-bf74-4a22-b346-59d362164c94 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:13.062367 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5581b7-bf74-4a22-b346-59d362164c94 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:13.062639 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5581b7-bf74-4a22-b346-59d362164c94 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:13.063388 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5581b7-bf74-4a22-b346-59d362164c94 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:13.063694 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5581b7-bf74-4a22-b346-59d362164c94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:13.065121 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5581b7-bf74-4a22-b346-59d362164c94 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:13.073522 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 156/314] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Jun 18 04:05:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:13.081676 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c09276a-15b4-4b09-a7e0-4ab8d8781a67 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:13.186132 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c09276a-15b4-4b09-a7e0-4ab8d8781a67 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:13.214858 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:13.221102 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be30affa-51ee-4432-bfac-0dd4296bc9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:13.222030 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be30affa-51ee-4432-bfac-0dd4296bc9bf None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:13.222303 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be30affa-51ee-4432-bfac-0dd4296bc9bf None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:13.222566 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be30affa-51ee-4432-bfac-0dd4296bc9bf None admin] PATH_INFO: `/v3/users/cee306c8db5248a4a7ab99e4242aa3ec` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:13.223807 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be30affa-51ee-4432-bfac-0dd4296bc9bf None admin] RBAC: Authorizing `identity:get_user(user_id=cee306c8db5248a4a7ab99e4242aa3ec)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:13.225629 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be30affa-51ee-4432-bfac-0dd4296bc9bf None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:13.227966 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 159/315] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Jun 18 04:05:13 2022] GET /identity/v3/users/cee306c8db5248a4a7ab99e4242aa3ec => generated 297 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:13.233191 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5581b7-bf74-4a22-b346-59d362164c94 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:13.267107 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:13.340296 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5581b7-bf74-4a22-b346-59d362164c94 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:13.374255 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d88964-fe94-4549-bd04-7a7f15e26bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:13.374908 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d88964-fe94-4549-bd04-7a7f15e26bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:13.375187 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d88964-fe94-4549-bd04-7a7f15e26bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:13.375458 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d88964-fe94-4549-bd04-7a7f15e26bc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:13.445393 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d88964-fe94-4549-bd04-7a7f15e26bc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:13.446879 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d88964-fe94-4549-bd04-7a7f15e26bc7 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:13.480928 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:13.546800 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 157/316] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Jun 18 04:05:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 04:05:13.552547 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be30affa-51ee-4432-bfac-0dd4296bc9bf None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:13.675980 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be30affa-51ee-4432-bfac-0dd4296bc9bf None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:13.709903 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8814bf48-1532-4bce-ae99-e65231c5c049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:13.710773 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814bf48-1532-4bce-ae99-e65231c5c049 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:13.711050 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814bf48-1532-4bce-ae99-e65231c5c049 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:13.711318 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814bf48-1532-4bce-ae99-e65231c5c049 None admin] PATH_INFO: `/v3/projects/a7f9d08dadd24d78b125397d1904ae7d` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:13.712494 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8814bf48-1532-4bce-ae99-e65231c5c049 None admin] RBAC: Authorizing `identity:get_project(project_id=a7f9d08dadd24d78b125397d1904ae7d)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:13.714011 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8814bf48-1532-4bce-ae99-e65231c5c049 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:13.716114 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 160/317] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Jun 18 04:05:13 2022] GET /identity/v3/projects/a7f9d08dadd24d78b125397d1904ae7d => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:13.721914 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d88964-fe94-4549-bd04-7a7f15e26bc7 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:13.825351 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d88964-fe94-4549-bd04-7a7f15e26bc7 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:13.856617 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:13.860782 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ad725-83a2-46ce-8c6a-1d28c00640fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:13.861449 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ad725-83a2-46ce-8c6a-1d28c00640fe None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:13.861737 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ad725-83a2-46ce-8c6a-1d28c00640fe None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:13.862133 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ad725-83a2-46ce-8c6a-1d28c00640fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:13.863016 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ad725-83a2-46ce-8c6a-1d28c00640fe None admin] RBAC: Adding query filter params (role.id=3af5984773ef41448b3d4ef5e617e090, scope.project.id=a7f9d08dadd24d78b125397d1904ae7d, user.id=cee306c8db5248a4a7ab99e4242aa3ec) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:13.863358 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ad725-83a2-46ce-8c6a-1d28c00640fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:13.865474 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ad725-83a2-46ce-8c6a-1d28c00640fe None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:13.872065 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 158/318] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Jun 18 04:05:13 2022] GET /identity/v3/role_assignments?user.id=cee306c8db5248a4a7ab99e4242aa3ec&scope.project.id=a7f9d08dadd24d78b125397d1904ae7d&role.id=3af5984773ef41448b3d4ef5e617e090 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:14.355775 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5286fbcd-48d9-4a6b-9164-337b9236382e None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:14.356006 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5286fbcd-48d9-4a6b-9164-337b9236382e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:14.356275 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5286fbcd-48d9-4a6b-9164-337b9236382e None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:14.357826 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 161/319] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:05:14.363466 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aff1d2-7981-4571-a5d9-895713eaff97 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:14.363940 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aff1d2-7981-4571-a5d9-895713eaff97 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:14.364038 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aff1d2-7981-4571-a5d9-895713eaff97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:14.381157 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-96aff1d2-7981-4571-a5d9-895713eaff97 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:14.382311 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-96aff1d2-7981-4571-a5d9-895713eaff97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:14.452865 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 159/320] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:05:14.474676 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5286fbcd-48d9-4a6b-9164-337b9236382e None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:14.545077 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:14.546493 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be4eb2-97d8-44ba-b777-1d060f0b1689 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:14.546780 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be4eb2-97d8-44ba-b777-1d060f0b1689 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:14.547059 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be4eb2-97d8-44ba-b777-1d060f0b1689 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:14.548626 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 160/321] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:05:14.553580 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b619395-79b0-4139-be84-f8c5e7964aa4 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:14.553861 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b619395-79b0-4139-be84-f8c5e7964aa4 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:14.554134 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b619395-79b0-4139-be84-f8c5e7964aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:14.570862 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-7b619395-79b0-4139-be84-f8c5e7964aa4 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:14.572068 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-7b619395-79b0-4139-be84-f8c5e7964aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:14.585756 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5286fbcd-48d9-4a6b-9164-337b9236382e None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:14.620335 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d2210-bf5b-4839-8c97-c4f599023e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:14.621082 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d2210-bf5b-4839-8c97-c4f599023e2c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:14.621360 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d2210-bf5b-4839-8c97-c4f599023e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:14.621633 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d2210-bf5b-4839-8c97-c4f599023e2c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:14.631748 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1d2210-bf5b-4839-8c97-c4f599023e2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:05:14.639599 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-db1d2210-bf5b-4839-8c97-c4f599023e2c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 18 04:05:14.639599 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:14.639599 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:14.639599 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:14.639599 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:14.639599 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:14.639599 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:14.639599 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:14.639599 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:14.639599 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:14.639599 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:14.639599 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:14.639599 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:05:14.639599 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:05:14.639599 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:05:14.639599 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:05:14.640490 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:05:14.640490 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:05:14.640490 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:05:14.640490 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:05:14.640490 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:14.640490 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:14.640490 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:14.640490 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:14.640490 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:14.640490 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:14.640490 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:14.640490 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:14.640490 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:14.640490 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:14.640490 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:14.640490 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:14.641305 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:14.641305 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:14.641305 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:14.641305 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:14.641305 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:05:14.641305 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:05:14.641305 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:05:14.641305 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:05:14.641305 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:05:14.641305 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:05:14.641305 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 18 04:05:14.641305 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:14.641305 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 162/322] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Jun 18 04:05:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:14.642071 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529f83d-5176-4f5c-8cd0-c9e9b77fc673 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:14.642495 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529f83d-5176-4f5c-8cd0-c9e9b77fc673 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:14.642605 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529f83d-5176-4f5c-8cd0-c9e9b77fc673 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:14.643855 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 163/323] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:05:14.646824 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2529f83d-5176-4f5c-8cd0-c9e9b77fc673 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:14.647494 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 161/324] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:05:14.649288 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6881299-f7ec-4c48-b376-ce56aa9a9f5b None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:14.649574 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6881299-f7ec-4c48-b376-ce56aa9a9f5b None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:14.649846 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6881299-f7ec-4c48-b376-ce56aa9a9f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:14.666189 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-c6881299-f7ec-4c48-b376-ce56aa9a9f5b None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:14.667425 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c6881299-f7ec-4c48-b376-ce56aa9a9f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:14.715765 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:14.732676 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 162/325] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 18 04:05:14.733497 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6881299-f7ec-4c48-b376-ce56aa9a9f5b None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:14.750788 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2529f83d-5176-4f5c-8cd0-c9e9b77fc673 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:14.776316 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:14.785030 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d228b68c-0d1d-4e80-a6eb-0acf0ee7adc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:14.785737 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228b68c-0d1d-4e80-a6eb-0acf0ee7adc9 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:14.786014 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228b68c-0d1d-4e80-a6eb-0acf0ee7adc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:14.786288 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228b68c-0d1d-4e80-a6eb-0acf0ee7adc9 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:14.787045 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d228b68c-0d1d-4e80-a6eb-0acf0ee7adc9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:14.787353 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d228b68c-0d1d-4e80-a6eb-0acf0ee7adc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:14.788779 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d228b68c-0d1d-4e80-a6eb-0acf0ee7adc9 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:14.797555 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 164/326] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Jun 18 04:05:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:05:14.797555 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d228b68c-0d1d-4e80-a6eb-0acf0ee7adc9 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:14.836649 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6881299-f7ec-4c48-b376-ce56aa9a9f5b None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:14.871058 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58dbbe-7468-4bdb-bf62-4707ef9ddfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:14.871769 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58dbbe-7468-4bdb-bf62-4707ef9ddfa4 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:14.872047 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58dbbe-7468-4bdb-bf62-4707ef9ddfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:14.872320 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58dbbe-7468-4bdb-bf62-4707ef9ddfa4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:14.873508 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d58dbbe-7468-4bdb-bf62-4707ef9ddfa4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:14.874982 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d58dbbe-7468-4bdb-bf62-4707ef9ddfa4 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:14.876618 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 163/327] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:05:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:14.877376 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58dbbe-7468-4bdb-bf62-4707ef9ddfa4 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:14.899157 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d228b68c-0d1d-4e80-a6eb-0acf0ee7adc9 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:14.930111 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:14.933024 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c18537-3874-4bfc-9ee0-6470fda2f26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:14.933824 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c18537-3874-4bfc-9ee0-6470fda2f26d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:14.934111 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c18537-3874-4bfc-9ee0-6470fda2f26d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:14.934380 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c18537-3874-4bfc-9ee0-6470fda2f26d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:14.944993 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c18537-3874-4bfc-9ee0-6470fda2f26d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:05:14.952718 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-21c18537-3874-4bfc-9ee0-6470fda2f26d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 18 04:05:14.952718 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:14.952718 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:14.952718 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:14.952718 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:14.952718 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:14.952718 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:14.952718 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:14.952718 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:14.952718 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:14.952718 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:14.952718 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:14.952718 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:05:14.952718 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:05:14.952718 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:05:14.952718 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:05:14.953792 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:05:14.953792 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:05:14.953792 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:05:14.953792 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:05:14.953792 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:14.953792 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:14.953792 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:14.953792 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:14.953792 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:14.953792 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:14.953792 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:14.953792 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:14.953792 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:14.953792 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:14.953792 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:14.953792 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:14.954593 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:14.954593 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:14.954593 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:14.954593 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:14.954593 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:05:14.954593 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:05:14.954593 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:05:14.954593 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:05:14.954593 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:05:14.954593 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:05:14.954593 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 18 04:05:14.954593 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:14.954593 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 165/328] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Jun 18 04:05:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:14.955236 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c18537-3874-4bfc-9ee0-6470fda2f26d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:14.982386 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58dbbe-7468-4bdb-bf62-4707ef9ddfa4 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:15.004760 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:15.016789 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f5aeff-38e3-47db-a1fa-3611cc97252e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:15.017672 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5aeff-38e3-47db-a1fa-3611cc97252e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:15.017970 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5aeff-38e3-47db-a1fa-3611cc97252e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:15.018218 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5aeff-38e3-47db-a1fa-3611cc97252e None admin] PATH_INFO: `/v3/users/c1c470f76a6a48d298bb5cb96df9458e` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:15.019401 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f5aeff-38e3-47db-a1fa-3611cc97252e None admin] RBAC: Authorizing `identity:get_user(user_id=c1c470f76a6a48d298bb5cb96df9458e)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:15.020874 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f5aeff-38e3-47db-a1fa-3611cc97252e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:15.022738 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 164/329] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Jun 18 04:05:14 2022] GET /identity/v3/users/c1c470f76a6a48d298bb5cb96df9458e => generated 293 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:15.023273 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f5aeff-38e3-47db-a1fa-3611cc97252e None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:15.056373 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c18537-3874-4bfc-9ee0-6470fda2f26d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:15.089138 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1279bc-5b5c-4668-8ca8-eccbd0f518cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:15.089800 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1279bc-5b5c-4668-8ca8-eccbd0f518cb None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:15.090077 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1279bc-5b5c-4668-8ca8-eccbd0f518cb None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:15.090347 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1279bc-5b5c-4668-8ca8-eccbd0f518cb None admin] PATH_INFO: `/v3/groups` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:15.091033 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1279bc-5b5c-4668-8ca8-eccbd0f518cb None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:15.092469 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1279bc-5b5c-4668-8ca8-eccbd0f518cb None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:15.107460 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 166/330] 10.222.0.20 () {60 vars in 1134 bytes} [Sat Jun 18 04:05:14 2022] POST /identity/v3/groups => generated 226 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 04:05:15.108234 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1279bc-5b5c-4668-8ca8-eccbd0f518cb None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:15.139153 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f5aeff-38e3-47db-a1fa-3611cc97252e None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:15.168075 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:15.185056 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd70b2-16e5-4028-bf80-77450ec53752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:15.185720 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd70b2-16e5-4028-bf80-77450ec53752 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:15.185993 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd70b2-16e5-4028-bf80-77450ec53752 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:15.186269 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd70b2-16e5-4028-bf80-77450ec53752 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:15.187030 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cd70b2-16e5-4028-bf80-77450ec53752 None admin] RBAC: Adding query filter params (name=member) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:15.187330 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cd70b2-16e5-4028-bf80-77450ec53752 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:15.188776 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cd70b2-16e5-4028-bf80-77450ec53752 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:15.199391 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 165/331] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Jun 18 04:05:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:15.205259 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd70b2-16e5-4028-bf80-77450ec53752 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:15.226095 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1279bc-5b5c-4668-8ca8-eccbd0f518cb None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:15.236378 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:15.268005 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cdbba4-ae0a-4c4a-9a5e-4c69a9b732f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:15.269484 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cdbba4-ae0a-4c4a-9a5e-4c69a9b732f5 None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:15.269484 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cdbba4-ae0a-4c4a-9a5e-4c69a9b732f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:15.269484 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cdbba4-ae0a-4c4a-9a5e-4c69a9b732f5 None admin] PATH_INFO: `/v3/system/users/c1c470f76a6a48d298bb5cb96df9458e/roles/3af5984773ef41448b3d4ef5e617e090` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:15.270888 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cdbba4-ae0a-4c4a-9a5e-4c69a9b732f5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c1c470f76a6a48d298bb5cb96df9458e, role_id=3af5984773ef41448b3d4ef5e617e090)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:15.272298 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cdbba4-ae0a-4c4a-9a5e-4c69a9b732f5 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:15.282570 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 167/332] 10.222.0.20 () {58 vars in 1334 bytes} [Sat Jun 18 04:05:15 2022] PUT /identity/v3/system/users/c1c470f76a6a48d298bb5cb96df9458e/roles/3af5984773ef41448b3d4ef5e617e090 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 04:05:15.330149 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd70b2-16e5-4028-bf80-77450ec53752 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:15.377268 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d47602-701c-46df-ad22-86ab0c7c9175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:15.378178 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d47602-701c-46df-ad22-86ab0c7c9175 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:15.378458 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d47602-701c-46df-ad22-86ab0c7c9175 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:15.378756 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d47602-701c-46df-ad22-86ab0c7c9175 None admin] PATH_INFO: `/v3/users/007123ec376644a69edbb913114cb61f` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:15.380073 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d47602-701c-46df-ad22-86ab0c7c9175 None admin] RBAC: Authorizing `identity:get_user(user_id=007123ec376644a69edbb913114cb61f)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:15.381619 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d47602-701c-46df-ad22-86ab0c7c9175 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:15.383578 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 166/333] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Jun 18 04:05:15 2022] GET /identity/v3/users/007123ec376644a69edbb913114cb61f => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:05:15.389988 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cdbba4-ae0a-4c4a-9a5e-4c69a9b732f5 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:15.500346 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cdbba4-ae0a-4c4a-9a5e-4c69a9b732f5 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:15.536148 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdaefce-ca35-4fe7-9f95-8f0dd19031d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:15.536842 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdaefce-ca35-4fe7-9f95-8f0dd19031d0 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:15.537120 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdaefce-ca35-4fe7-9f95-8f0dd19031d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:15.537394 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdaefce-ca35-4fe7-9f95-8f0dd19031d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:15.538234 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdaefce-ca35-4fe7-9f95-8f0dd19031d0 None admin] RBAC: Adding query filter params (role.id=d74f7ad64e584e6186564837fa3cf380, user.id=007123ec376644a69edbb913114cb61f, scope.system=all) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:15.538543 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdaefce-ca35-4fe7-9f95-8f0dd19031d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:15.540036 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdaefce-ca35-4fe7-9f95-8f0dd19031d0 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:15.553177 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 168/334] 10.222.0.20 () {56 vars in 1308 bytes} [Sat Jun 18 04:05:15 2022] GET /identity/v3/role_assignments?user.id=007123ec376644a69edbb913114cb61f&scope.system=all&role.id=d74f7ad64e584e6186564837fa3cf380 => generated 510 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:17.540815 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ff0ac-d215-4c32-83d9-af9f7cdd32bd None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:17.541344 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ff0ac-d215-4c32-83d9-af9f7cdd32bd None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:17.541344 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ff0ac-d215-4c32-83d9-af9f7cdd32bd None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:17.542965 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 167/335] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:05:17.548626 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1e704-4f3d-4706-9757-27681145fcfd None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:17.549098 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1e704-4f3d-4706-9757-27681145fcfd None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:17.549183 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1e704-4f3d-4706-9757-27681145fcfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:17.573813 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-69d1e704-4f3d-4706-9757-27681145fcfd None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:17.575052 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-69d1e704-4f3d-4706-9757-27681145fcfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:17.601767 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:17.648473 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd7c24-2201-49c6-bb74-2783088b1efc None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:17.649024 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd7c24-2201-49c6-bb74-2783088b1efc None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:17.649302 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd7c24-2201-49c6-bb74-2783088b1efc None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:17.651024 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 168/336] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:05:17.656306 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fdec61-d06d-4bec-9693-a1214776b7f2 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:17.656661 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fdec61-d06d-4bec-9693-a1214776b7f2 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:17.657017 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fdec61-d06d-4bec-9693-a1214776b7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:17.657968 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 169/337] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:05:17.680083 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-14fdec61-d06d-4bec-9693-a1214776b7f2 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:17.681281 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-14fdec61-d06d-4bec-9693-a1214776b7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:17.695530 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1e704-4f3d-4706-9757-27681145fcfd None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:17.761998 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:17.792538 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 169/338] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:05:17.837001 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fdec61-d06d-4bec-9693-a1214776b7f2 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:17.852167 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1e704-4f3d-4706-9757-27681145fcfd None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:17.905368 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca15038d-2550-427d-b811-c9b69aa78fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:17.906180 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15038d-2550-427d-b811-c9b69aa78fbe None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:17.906461 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15038d-2550-427d-b811-c9b69aa78fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:17.906728 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15038d-2550-427d-b811-c9b69aa78fbe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:17.922083 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca15038d-2550-427d-b811-c9b69aa78fbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:05:17.934356 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-ca15038d-2550-427d-b811-c9b69aa78fbe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 18 04:05:17.934356 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:17.934356 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:17.934356 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:17.934356 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:17.934356 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:17.934356 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:17.934356 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:17.934356 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:17.934356 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:17.934356 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:17.934356 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:17.934356 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:05:17.934356 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:05:17.934356 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:05:17.934356 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:05:17.935271 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:05:17.935271 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:05:17.935271 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:05:17.935271 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:05:17.935271 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:17.935271 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:17.935271 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:17.935271 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:17.935271 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:17.935271 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:17.935271 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:17.935271 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:17.935271 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:17.935271 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:17.935271 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:17.935271 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:17.936057 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:17.936057 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:17.936057 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:17.936057 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:17.936057 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:05:17.936057 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:05:17.936057 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:05:17.936057 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:05:17.936057 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:05:17.936057 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:05:17.936057 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 18 04:05:17.936057 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:17.936057 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 170/339] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Jun 18 04:05:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 04:05:17.941300 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca15038d-2550-427d-b811-c9b69aa78fbe None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:17.974943 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:17.995844 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fdec61-d06d-4bec-9693-a1214776b7f2 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:18.035943 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db86903-16bb-44eb-8cde-198f9711873b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:18.037111 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db86903-16bb-44eb-8cde-198f9711873b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:18.037560 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db86903-16bb-44eb-8cde-198f9711873b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:18.037995 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db86903-16bb-44eb-8cde-198f9711873b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:18.051198 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db86903-16bb-44eb-8cde-198f9711873b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:05:18.059339 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-0db86903-16bb-44eb-8cde-198f9711873b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 18 04:05:18.059339 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:18.059339 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:18.059339 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:18.059339 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:18.059339 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:18.059339 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:18.059339 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:18.059339 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:18.059339 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:18.059339 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:18.059339 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:18.059339 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:05:18.059339 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:05:18.059339 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:05:18.059339 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:05:18.060205 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:05:18.060205 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:05:18.060205 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:05:18.060205 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:05:18.060205 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:18.060205 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:18.060205 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:18.060205 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:18.060205 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:18.060205 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:18.060205 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:18.060205 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:18.060205 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:18.060205 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:18.060205 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:18.060205 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:18.061024 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:18.061024 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:18.061024 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:18.061024 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:18.061024 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:05:18.061024 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:05:18.061024 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:05:18.061024 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:05:18.061024 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:05:18.061024 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:05:18.061024 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 18 04:05:18.061024 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:05:18.063588 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 170/340] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Jun 18 04:05:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 04:05:18.073737 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db86903-16bb-44eb-8cde-198f9711873b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:18.095188 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca15038d-2550-427d-b811-c9b69aa78fbe None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:18.148266 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:18.150010 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af36db-9858-4a36-9e84-c57d5d8f10e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:18.150705 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af36db-9858-4a36-9e84-c57d5d8f10e2 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:18.151045 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af36db-9858-4a36-9e84-c57d5d8f10e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:18.151314 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af36db-9858-4a36-9e84-c57d5d8f10e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:18.152187 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11af36db-9858-4a36-9e84-c57d5d8f10e2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:18.152492 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11af36db-9858-4a36-9e84-c57d5d8f10e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:18.157873 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11af36db-9858-4a36-9e84-c57d5d8f10e2 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:18.167303 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 171/341] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Jun 18 04:05:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:18.172427 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af36db-9858-4a36-9e84-c57d5d8f10e2 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:18.232943 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db86903-16bb-44eb-8cde-198f9711873b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:18.274353 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:18.276308 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc035fab-36de-4ca3-bb40-510b79f3f3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:18.277161 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc035fab-36de-4ca3-bb40-510b79f3f3cb None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:18.277446 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc035fab-36de-4ca3-bb40-510b79f3f3cb None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:18.277726 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc035fab-36de-4ca3-bb40-510b79f3f3cb None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:18.279336 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc035fab-36de-4ca3-bb40-510b79f3f3cb None admin] RBAC: Adding query filter params (name=member) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:18.279648 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc035fab-36de-4ca3-bb40-510b79f3f3cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:18.281129 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc035fab-36de-4ca3-bb40-510b79f3f3cb None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:18.290430 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 171/342] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Jun 18 04:05:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:18.291888 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ac5a1-d87d-4519-b70b-8150463d4816 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:18.292172 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ac5a1-d87d-4519-b70b-8150463d4816 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:18.292449 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ac5a1-d87d-4519-b70b-8150463d4816 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:18.294214 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af36db-9858-4a36-9e84-c57d5d8f10e2 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:18.294788 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 172/343] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:05:18.295848 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc003cc0-f90c-4201-abad-3f17066b0417 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:18.296125 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc003cc0-f90c-4201-abad-3f17066b0417 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:18.296394 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc003cc0-f90c-4201-abad-3f17066b0417 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:18.301796 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 173/344] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:05:18.302526 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc003cc0-f90c-4201-abad-3f17066b0417 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:18.335266 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b59682c-ade2-4423-9300-f56ed10e6528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:18.336440 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59682c-ade2-4423-9300-f56ed10e6528 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:18.336748 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59682c-ade2-4423-9300-f56ed10e6528 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:18.337285 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59682c-ade2-4423-9300-f56ed10e6528 None admin] PATH_INFO: `/v3/users/c1c470f76a6a48d298bb5cb96df9458e` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:18.339243 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b59682c-ade2-4423-9300-f56ed10e6528 None admin] RBAC: Authorizing `identity:get_user(user_id=c1c470f76a6a48d298bb5cb96df9458e)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:18.340795 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b59682c-ade2-4423-9300-f56ed10e6528 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:18.343952 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 172/345] 10.222.0.20 () {56 vars in 1177 bytes} [Sat Jun 18 04:05:18 2022] GET /identity/v3/users/c1c470f76a6a48d298bb5cb96df9458e => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:18.345279 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06ee55-ffb1-40ad-a083-a1b602fa9856 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:18.345562 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06ee55-ffb1-40ad-a083-a1b602fa9856 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:18.345836 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06ee55-ffb1-40ad-a083-a1b602fa9856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:18.366722 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-5d06ee55-ffb1-40ad-a083-a1b602fa9856 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:18.368430 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-5d06ee55-ffb1-40ad-a083-a1b602fa9856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:18.424273 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc003cc0-f90c-4201-abad-3f17066b0417 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:18.426038 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:18.453428 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 173/346] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:05:18.454558 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003ca75-ee58-4106-8416-1c8dffab1a96 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:18.454912 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003ca75-ee58-4106-8416-1c8dffab1a96 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:18.455795 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003ca75-ee58-4106-8416-1c8dffab1a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:18.475767 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-f003ca75-ee58-4106-8416-1c8dffab1a96 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:18.476025 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f74c32e-fcff-44ab-8f2d-a8f7ffe9069a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:18.476851 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74c32e-fcff-44ab-8f2d-a8f7ffe9069a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:18.477017 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f003ca75-ee58-4106-8416-1c8dffab1a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:18.477265 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74c32e-fcff-44ab-8f2d-a8f7ffe9069a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:18.477595 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74c32e-fcff-44ab-8f2d-a8f7ffe9069a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:18.558589 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f74c32e-fcff-44ab-8f2d-a8f7ffe9069a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:18.559978 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f74c32e-fcff-44ab-8f2d-a8f7ffe9069a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:18.564315 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 174/347] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:05:18.565218 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003ca75-ee58-4106-8416-1c8dffab1a96 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:18.580164 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:18.673230 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 174/348] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Jun 18 04:05:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 04:05:18.674328 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f74c32e-fcff-44ab-8f2d-a8f7ffe9069a None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:18.678858 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:18.683179 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003ca75-ee58-4106-8416-1c8dffab1a96 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:18.731440 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac904d4-047b-41e1-9eb3-ca3b528ee5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:18.732351 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac904d4-047b-41e1-9eb3-ca3b528ee5a4 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:18.732805 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac904d4-047b-41e1-9eb3-ca3b528ee5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:18.733224 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac904d4-047b-41e1-9eb3-ca3b528ee5a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:18.734226 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac904d4-047b-41e1-9eb3-ca3b528ee5a4 None admin] RBAC: Adding query filter params (role.id=3af5984773ef41448b3d4ef5e617e090, user.id=c1c470f76a6a48d298bb5cb96df9458e, scope.system=all) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:18.735029 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac904d4-047b-41e1-9eb3-ca3b528ee5a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:18.736646 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac904d4-047b-41e1-9eb3-ca3b528ee5a4 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:18.753863 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 175/349] 10.222.0.20 () {56 vars in 1308 bytes} [Sat Jun 18 04:05:18 2022] GET /identity/v3/role_assignments?user.id=c1c470f76a6a48d298bb5cb96df9458e&scope.system=all&role.id=3af5984773ef41448b3d4ef5e617e090 => generated 510 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:18.755014 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac904d4-047b-41e1-9eb3-ca3b528ee5a4 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:18.831070 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f74c32e-fcff-44ab-8f2d-a8f7ffe9069a None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:18.858385 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:18.880386 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa73436-f455-4edd-aa8a-3620848242d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:18.881574 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa73436-f455-4edd-aa8a-3620848242d1 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:18.882077 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa73436-f455-4edd-aa8a-3620848242d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:18.882647 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa73436-f455-4edd-aa8a-3620848242d1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:18.896762 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa73436-f455-4edd-aa8a-3620848242d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:05:18.905147 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-9fa73436-f455-4edd-aa8a-3620848242d1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 18 04:05:18.905147 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:18.905147 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:18.905147 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:18.905147 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:18.905147 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:18.905147 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:18.905147 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:18.905147 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:18.905147 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:18.905147 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:18.905147 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:18.905147 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:05:18.905147 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:05:18.905147 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:05:18.905147 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:05:18.906103 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:05:18.906103 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:05:18.906103 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:05:18.906103 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:05:18.906103 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:18.906103 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:18.906103 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:18.906103 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:18.906103 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:18.906103 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:18.906103 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:18.906103 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:18.906103 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:18.906103 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:18.906103 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:18.906103 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:18.906912 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:18.906912 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:18.906912 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:18.906912 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:18.906912 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:05:18.906912 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:05:18.906912 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:05:18.906912 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:05:18.906912 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:05:18.906912 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:05:18.906912 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 18 04:05:18.906912 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:05:18.907519 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac904d4-047b-41e1-9eb3-ca3b528ee5a4 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:18.909762 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 175/350] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Jun 18 04:05:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:18.910790 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa73436-f455-4edd-aa8a-3620848242d1 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:18.951094 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084aef1-0faa-48ff-8de3-442b496b2dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:18.951983 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084aef1-0faa-48ff-8de3-442b496b2dba None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:18.952307 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084aef1-0faa-48ff-8de3-442b496b2dba None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:18.952603 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084aef1-0faa-48ff-8de3-442b496b2dba None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:18.966242 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d084aef1-0faa-48ff-8de3-442b496b2dba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:05:18.976828 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-d084aef1-0faa-48ff-8de3-442b496b2dba None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 18 04:05:18.976828 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:18.976828 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:18.976828 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:18.976828 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:18.976828 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:18.976828 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:18.976828 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:18.976828 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:18.976828 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:18.976828 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:18.976828 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:18.976828 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:05:18.976828 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:05:18.976828 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:05:18.976828 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:05:18.977739 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:05:18.977739 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:05:18.977739 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:05:18.977739 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:05:18.977739 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:18.977739 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:18.977739 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:18.977739 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:18.977739 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:18.977739 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:18.977739 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:18.977739 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:18.977739 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:18.977739 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:18.977739 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:18.977739 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:18.978548 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:18.978548 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:18.978548 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:18.978548 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:18.978548 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:05:18.978548 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:05:18.978548 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:05:18.978548 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:05:18.978548 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:05:18.978548 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:05:18.978548 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 18 04:05:18.978548 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:18.978548 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 176/351] 10.222.0.20 () {56 vars in 1114 bytes} [Sat Jun 18 04:05:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:18.979791 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084aef1-0faa-48ff-8de3-442b496b2dba None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:19.022618 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:19.084363 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa73436-f455-4edd-aa8a-3620848242d1 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:19.117533 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084aef1-0faa-48ff-8de3-442b496b2dba None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:19.123667 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff1b0c5-ff22-49ac-9723-4a2cba86f11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:19.124597 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1b0c5-ff22-49ac-9723-4a2cba86f11d None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:19.124911 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1b0c5-ff22-49ac-9723-4a2cba86f11d None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:19.125178 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1b0c5-ff22-49ac-9723-4a2cba86f11d None admin] PATH_INFO: `/v3/projects/594195ae8d4c49c8babdbc7125c60372` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:19.126368 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff1b0c5-ff22-49ac-9723-4a2cba86f11d None admin] RBAC: Authorizing `identity:get_project(project_id=594195ae8d4c49c8babdbc7125c60372)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:19.127818 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff1b0c5-ff22-49ac-9723-4a2cba86f11d None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:19.131807 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 176/352] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Jun 18 04:05:18 2022] GET /identity/v3/projects/594195ae8d4c49c8babdbc7125c60372 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:19.134264 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff1b0c5-ff22-49ac-9723-4a2cba86f11d None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:19.149554 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:19.160021 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ba001-f97f-4c23-8ee3-eb1b65f0641e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:19.160727 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ba001-f97f-4c23-8ee3-eb1b65f0641e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:19.161321 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ba001-f97f-4c23-8ee3-eb1b65f0641e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:19.161606 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ba001-f97f-4c23-8ee3-eb1b65f0641e None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:19.162370 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2ba001-f97f-4c23-8ee3-eb1b65f0641e None admin] RBAC: Adding query filter params (name=member) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:19.162675 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2ba001-f97f-4c23-8ee3-eb1b65f0641e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:19.164909 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2ba001-f97f-4c23-8ee3-eb1b65f0641e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:19.178530 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 177/353] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Jun 18 04:05:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:19.179426 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ba001-f97f-4c23-8ee3-eb1b65f0641e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:19.266242 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff1b0c5-ff22-49ac-9723-4a2cba86f11d None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:19.312029 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:19.314882 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aa0fee-a291-445e-8b1a-369901ae2221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:19.315798 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa0fee-a291-445e-8b1a-369901ae2221 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:19.316335 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa0fee-a291-445e-8b1a-369901ae2221 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:19.316819 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa0fee-a291-445e-8b1a-369901ae2221 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:19.317779 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aa0fee-a291-445e-8b1a-369901ae2221 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:19.318351 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aa0fee-a291-445e-8b1a-369901ae2221 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:19.319896 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aa0fee-a291-445e-8b1a-369901ae2221 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:19.329284 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ba001-f97f-4c23-8ee3-eb1b65f0641e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:19.329799 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 177/354] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Jun 18 04:05:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:19.330892 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aa0fee-a291-445e-8b1a-369901ae2221 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:19.375844 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6eb9f9-3a95-40a0-adfe-69f0cf08091d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:19.376642 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6eb9f9-3a95-40a0-adfe-69f0cf08091d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:19.376923 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6eb9f9-3a95-40a0-adfe-69f0cf08091d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:19.377278 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6eb9f9-3a95-40a0-adfe-69f0cf08091d None admin] PATH_INFO: `/v3/groups/556f5b841fe2406881a0ad69e9c716d0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:19.385769 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6eb9f9-3a95-40a0-adfe-69f0cf08091d None admin] RBAC: Authorizing `identity:get_group(group_id=556f5b841fe2406881a0ad69e9c716d0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:19.387231 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6eb9f9-3a95-40a0-adfe-69f0cf08091d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:19.389362 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 178/355] 10.222.0.20 () {56 vars in 1180 bytes} [Sat Jun 18 04:05:19 2022] GET /identity/v3/groups/556f5b841fe2406881a0ad69e9c716d0 => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:19.390203 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6eb9f9-3a95-40a0-adfe-69f0cf08091d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:19.445509 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aa0fee-a291-445e-8b1a-369901ae2221 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:19.460522 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:19.490650 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36231713-b1ac-4591-88f9-5f1c12da10d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:19.491309 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36231713-b1ac-4591-88f9-5f1c12da10d8 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:19.491586 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36231713-b1ac-4591-88f9-5f1c12da10d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:19.491854 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36231713-b1ac-4591-88f9-5f1c12da10d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:19.524733 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6eb9f9-3a95-40a0-adfe-69f0cf08091d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:19.574348 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc427f-0f09-4058-9dfd-53a6800a946d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:19.575069 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc427f-0f09-4058-9dfd-53a6800a946d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:19.575353 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc427f-0f09-4058-9dfd-53a6800a946d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:19.575622 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc427f-0f09-4058-9dfd-53a6800a946d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:19.577498 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:19.592864 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36231713-b1ac-4591-88f9-5f1c12da10d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:19.594899 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36231713-b1ac-4591-88f9-5f1c12da10d8 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:19.673697 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cc427f-0f09-4058-9dfd-53a6800a946d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:19.675087 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cc427f-0f09-4058-9dfd-53a6800a946d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:19.718425 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 178/356] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Jun 18 04:05:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 04:05:19.719609 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9814a6a2-e73c-4dee-ac2c-c3bea08a662b None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:19.719894 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9814a6a2-e73c-4dee-ac2c-c3bea08a662b None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:19.720163 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9814a6a2-e73c-4dee-ac2c-c3bea08a662b None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:19.721710 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 179/357] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:05:19.722411 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9814a6a2-e73c-4dee-ac2c-c3bea08a662b None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:19.754489 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:19.832016 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 179/358] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Jun 18 04:05:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 04:05:19.834671 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc427f-0f09-4058-9dfd-53a6800a946d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:19.849697 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:19.867533 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9814a6a2-e73c-4dee-ac2c-c3bea08a662b None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:19.908678 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3010afee-be7e-406a-a36e-d2ced0a7a0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:19.909345 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010afee-be7e-406a-a36e-d2ced0a7a0bd None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:19.909625 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010afee-be7e-406a-a36e-d2ced0a7a0bd None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:19.909900 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010afee-be7e-406a-a36e-d2ced0a7a0bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:19.910730 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3010afee-be7e-406a-a36e-d2ced0a7a0bd None admin] RBAC: Adding query filter params (group.id=556f5b841fe2406881a0ad69e9c716d0, role.id=d74f7ad64e584e6186564837fa3cf380, scope.project.id=594195ae8d4c49c8babdbc7125c60372) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:19.911033 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3010afee-be7e-406a-a36e-d2ced0a7a0bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:19.912484 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3010afee-be7e-406a-a36e-d2ced0a7a0bd None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:19.919414 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 180/359] 10.222.0.20 () {56 vars in 1376 bytes} [Sat Jun 18 04:05:19 2022] GET /identity/v3/role_assignments?group.id=556f5b841fe2406881a0ad69e9c716d0&scope.project.id=594195ae8d4c49c8babdbc7125c60372&role.id=d74f7ad64e584e6186564837fa3cf380 => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:19.924793 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d82a6-3a14-4fb4-8add-b782e2402a41 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:19.924793 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d82a6-3a14-4fb4-8add-b782e2402a41 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:19.924793 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d82a6-3a14-4fb4-8add-b782e2402a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:19.940413 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-034d82a6-3a14-4fb4-8add-b782e2402a41 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:19.941710 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-034d82a6-3a14-4fb4-8add-b782e2402a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:19.964814 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc427f-0f09-4058-9dfd-53a6800a946d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:20.008772 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d384c-f63a-4551-93e4-ba82773d9aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:20.010045 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d384c-f63a-4551-93e4-ba82773d9aba None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:20.010568 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d384c-f63a-4551-93e4-ba82773d9aba None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:20.011042 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d384c-f63a-4551-93e4-ba82773d9aba None admin] PATH_INFO: `/v3/projects/a7f9d08dadd24d78b125397d1904ae7d` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:20.012511 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652d384c-f63a-4551-93e4-ba82773d9aba None admin] RBAC: Authorizing `identity:get_project(project_id=a7f9d08dadd24d78b125397d1904ae7d)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:20.014333 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652d384c-f63a-4551-93e4-ba82773d9aba None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:20.021303 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 180/360] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Jun 18 04:05:19 2022] GET /identity/v3/projects/a7f9d08dadd24d78b125397d1904ae7d => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:20.022316 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d384c-f63a-4551-93e4-ba82773d9aba None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:20.041688 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 181/361] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:05:20.043134 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4353e38-486b-49e4-bd13-4d3c0401944f None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:20.043399 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4353e38-486b-49e4-bd13-4d3c0401944f None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:20.043675 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4353e38-486b-49e4-bd13-4d3c0401944f None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:20.045436 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 182/362] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:05:20.046188 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4353e38-486b-49e4-bd13-4d3c0401944f None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:20.053828 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:20.151964 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:20.153594 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d384c-f63a-4551-93e4-ba82773d9aba None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:20.173405 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4353e38-486b-49e4-bd13-4d3c0401944f None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:20.194006 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb122eb2-43d9-473b-8f62-f4b3371aef32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:20.194891 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb122eb2-43d9-473b-8f62-f4b3371aef32 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:20.195165 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb122eb2-43d9-473b-8f62-f4b3371aef32 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:20.195432 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb122eb2-43d9-473b-8f62-f4b3371aef32 None admin] PATH_INFO: `/v3/projects/594195ae8d4c49c8babdbc7125c60372` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:20.197089 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb122eb2-43d9-473b-8f62-f4b3371aef32 None admin] RBAC: Authorizing `identity:get_project(project_id=594195ae8d4c49c8babdbc7125c60372)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:20.198650 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb122eb2-43d9-473b-8f62-f4b3371aef32 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:20.204674 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 181/363] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Jun 18 04:05:20 2022] GET /identity/v3/projects/594195ae8d4c49c8babdbc7125c60372 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:20.204674 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe7551-3605-4920-aa78-ab906fe163ed None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:20.204674 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe7551-3605-4920-aa78-ab906fe163ed None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:20.204674 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe7551-3605-4920-aa78-ab906fe163ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:20.222695 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-28fe7551-3605-4920-aa78-ab906fe163ed None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:20.222695 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-28fe7551-3605-4920-aa78-ab906fe163ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:20.224774 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66960d8b-3e04-40b1-87a8-7b57cc07175f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:20.226436 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66960d8b-3e04-40b1-87a8-7b57cc07175f None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:20.226436 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66960d8b-3e04-40b1-87a8-7b57cc07175f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:20.226436 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66960d8b-3e04-40b1-87a8-7b57cc07175f None admin] PATH_INFO: `/v3/groups/556f5b841fe2406881a0ad69e9c716d0` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:20.227526 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66960d8b-3e04-40b1-87a8-7b57cc07175f None admin] RBAC: Authorizing `identity:get_group(group_id=556f5b841fe2406881a0ad69e9c716d0)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:20.229119 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66960d8b-3e04-40b1-87a8-7b57cc07175f None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:20.232880 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 183/364] 10.222.0.20 () {56 vars in 1180 bytes} [Sat Jun 18 04:05:20 2022] GET /identity/v3/groups/556f5b841fe2406881a0ad69e9c716d0 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:20.233733 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66960d8b-3e04-40b1-87a8-7b57cc07175f None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:20.316674 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 182/365] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:05:20.317547 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe7551-3605-4920-aa78-ab906fe163ed None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:20.345510 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:20.355353 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66960d8b-3e04-40b1-87a8-7b57cc07175f None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:20.403960 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee9856d-29c2-48e2-8737-26a9858226e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:20.404863 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9856d-29c2-48e2-8737-26a9858226e7 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:20.405132 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9856d-29c2-48e2-8737-26a9858226e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:20.405576 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9856d-29c2-48e2-8737-26a9858226e7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:20.417416 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee9856d-29c2-48e2-8737-26a9858226e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:05:20.425735 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-cee9856d-29c2-48e2-8737-26a9858226e7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 18 04:05:20.425735 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:20.425735 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:20.425735 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:20.425735 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:20.425735 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:20.425735 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:20.425735 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:20.425735 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:20.425735 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:20.425735 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:20.425735 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:20.425735 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:05:20.425735 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:05:20.425735 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:05:20.425735 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:05:20.426689 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:05:20.426689 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:05:20.426689 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:05:20.426689 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:05:20.426689 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:20.426689 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:20.426689 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:20.426689 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:20.426689 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:20.426689 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:20.426689 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:20.426689 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:20.426689 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:20.426689 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:20.426689 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:20.426689 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:20.427542 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:20.427542 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:20.427542 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:20.427542 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:20.427542 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:05:20.427542 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:05:20.427542 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:05:20.427542 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:05:20.427542 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:05:20.427542 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:05:20.427542 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 18 04:05:20.427542 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:05:20.427542 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 184/366] 10.222.0.20 () {56 vars in 1114 bytes} [Sat Jun 18 04:05:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:20.429390 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee9856d-29c2-48e2-8737-26a9858226e7 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:20.452507 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe7551-3605-4920-aa78-ab906fe163ed None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:20.454066 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:20.506263 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c54be-cc0e-4504-bd65-1256fdc47e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:20.507129 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c54be-cc0e-4504-bd65-1256fdc47e07 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:20.507405 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c54be-cc0e-4504-bd65-1256fdc47e07 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:20.507672 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c54be-cc0e-4504-bd65-1256fdc47e07 None admin] PATH_INFO: `/v3/groups/556f5b841fe2406881a0ad69e9c716d0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:20.509775 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181c54be-cc0e-4504-bd65-1256fdc47e07 None admin] RBAC: Authorizing `identity:get_group(group_id=556f5b841fe2406881a0ad69e9c716d0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:20.511374 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181c54be-cc0e-4504-bd65-1256fdc47e07 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:20.513569 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 183/367] 10.222.0.20 () {56 vars in 1180 bytes} [Sat Jun 18 04:05:20 2022] GET /identity/v3/groups/556f5b841fe2406881a0ad69e9c716d0 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:20.514420 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c54be-cc0e-4504-bd65-1256fdc47e07 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:20.561142 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee9856d-29c2-48e2-8737-26a9858226e7 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:20.604782 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f72a4-f71e-439b-8656-803c0199bcc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:20.606140 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f72a4-f71e-439b-8656-803c0199bcc0 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:20.606419 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f72a4-f71e-439b-8656-803c0199bcc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:20.606694 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f72a4-f71e-439b-8656-803c0199bcc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:20.607527 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2f72a4-f71e-439b-8656-803c0199bcc0 None admin] RBAC: Adding query filter params (group.id=556f5b841fe2406881a0ad69e9c716d0, role.id=d74f7ad64e584e6186564837fa3cf380, scope.project.id=a7f9d08dadd24d78b125397d1904ae7d) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:20.607838 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2f72a4-f71e-439b-8656-803c0199bcc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:20.609290 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2f72a4-f71e-439b-8656-803c0199bcc0 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:20.616333 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 185/368] 10.222.0.20 () {56 vars in 1376 bytes} [Sat Jun 18 04:05:20 2022] GET /identity/v3/role_assignments?group.id=556f5b841fe2406881a0ad69e9c716d0&scope.project.id=a7f9d08dadd24d78b125397d1904ae7d&role.id=d74f7ad64e584e6186564837fa3cf380 => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:20.617276 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f72a4-f71e-439b-8656-803c0199bcc0 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:20.641365 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:20.660710 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c54be-cc0e-4504-bd65-1256fdc47e07 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:20.710244 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bece23b-b933-4f4a-80ef-98d46bad798d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:20.711420 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bece23b-b933-4f4a-80ef-98d46bad798d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:20.711891 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bece23b-b933-4f4a-80ef-98d46bad798d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:20.712407 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bece23b-b933-4f4a-80ef-98d46bad798d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:20.716360 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:20.729644 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bece23b-b933-4f4a-80ef-98d46bad798d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:05:20.740944 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-6bece23b-b933-4f4a-80ef-98d46bad798d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 04:05:20.740944 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:20.740944 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:20.740944 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:20.740944 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:20.740944 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:20.740944 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:20.740944 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:20.740944 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:20.740944 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:20.740944 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:20.740944 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:20.740944 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:05:20.740944 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:05:20.740944 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:05:20.740944 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:05:20.741919 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:05:20.741919 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:05:20.741919 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:05:20.741919 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:05:20.741919 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:20.741919 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:20.741919 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:20.741919 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:20.741919 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:20.741919 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:20.741919 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:20.741919 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:20.741919 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:20.741919 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:20.741919 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:20.741919 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:20.743164 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:20.743164 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:20.743164 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:20.743164 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:20.743164 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:05:20.743164 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:05:20.743164 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:05:20.743164 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:05:20.743164 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:05:20.743164 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:05:20.743164 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 04:05:20.743164 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:20.743164 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 184/369] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Jun 18 04:05:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:20.743164 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bece23b-b933-4f4a-80ef-98d46bad798d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:20.760623 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f72a4-f71e-439b-8656-803c0199bcc0 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:20.814405 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d985ba0-d31e-478d-a2d9-ead48393b055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:20.815082 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d985ba0-d31e-478d-a2d9-ead48393b055 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:20.815364 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d985ba0-d31e-478d-a2d9-ead48393b055 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:20.815627 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d985ba0-d31e-478d-a2d9-ead48393b055 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:20.816382 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d985ba0-d31e-478d-a2d9-ead48393b055 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:20.816795 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d985ba0-d31e-478d-a2d9-ead48393b055 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:20.818193 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d985ba0-d31e-478d-a2d9-ead48393b055 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:20.828073 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 186/370] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Jun 18 04:05:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:20.828946 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d985ba0-d31e-478d-a2d9-ead48393b055 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:20.891695 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bece23b-b933-4f4a-80ef-98d46bad798d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:20.930322 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e5db4-2841-404e-9a33-d753ddedc747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:20.931355 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e5db4-2841-404e-9a33-d753ddedc747 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:20.931812 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e5db4-2841-404e-9a33-d753ddedc747 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:20.932408 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e5db4-2841-404e-9a33-d753ddedc747 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:20.933618 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456e5db4-2841-404e-9a33-d753ddedc747 None admin] RBAC: Adding query filter params (group.id=556f5b841fe2406881a0ad69e9c716d0, role.id=ba29217afc57483a90e90b287c480549, scope.project.id=594195ae8d4c49c8babdbc7125c60372) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:20.934097 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456e5db4-2841-404e-9a33-d753ddedc747 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:20.935696 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456e5db4-2841-404e-9a33-d753ddedc747 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:20.942482 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 185/371] 10.222.0.20 () {56 vars in 1376 bytes} [Sat Jun 18 04:05:20 2022] GET /identity/v3/role_assignments?group.id=556f5b841fe2406881a0ad69e9c716d0&scope.project.id=594195ae8d4c49c8babdbc7125c60372&role.id=ba29217afc57483a90e90b287c480549 => generated 260 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:20.943511 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e5db4-2841-404e-9a33-d753ddedc747 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:20.966652 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d985ba0-d31e-478d-a2d9-ead48393b055 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:20.974269 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:21.018767 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52128250-f3c8-4905-bebd-63816bca775c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:21.019540 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52128250-f3c8-4905-bebd-63816bca775c None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:21.020009 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52128250-f3c8-4905-bebd-63816bca775c None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:21.020463 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52128250-f3c8-4905-bebd-63816bca775c None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:21.021324 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52128250-f3c8-4905-bebd-63816bca775c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:21.021691 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52128250-f3c8-4905-bebd-63816bca775c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:21.024828 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52128250-f3c8-4905-bebd-63816bca775c None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:21.036616 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 187/372] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Jun 18 04:05:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:21.040675 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52128250-f3c8-4905-bebd-63816bca775c None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:21.044732 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:21.180949 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52128250-f3c8-4905-bebd-63816bca775c None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:21.220663 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d169a-9b6f-4336-893c-76df8033a72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:21.221212 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d169a-9b6f-4336-893c-76df8033a72a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:21.221493 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d169a-9b6f-4336-893c-76df8033a72a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:21.221763 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d169a-9b6f-4336-893c-76df8033a72a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:21.223717 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e5db4-2841-404e-9a33-d753ddedc747 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:21.287340 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd317ce3-691e-420c-b3a0-47312ec60189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:21.288387 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd317ce3-691e-420c-b3a0-47312ec60189 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:21.288928 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd317ce3-691e-420c-b3a0-47312ec60189 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:21.292199 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd317ce3-691e-420c-b3a0-47312ec60189 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:21.325401 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62d169a-9b6f-4336-893c-76df8033a72a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:21.328368 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62d169a-9b6f-4336-893c-76df8033a72a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:21.336895 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:21.397239 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd317ce3-691e-420c-b3a0-47312ec60189 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:21.399085 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd317ce3-691e-420c-b3a0-47312ec60189 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:21.421360 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:21.503152 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 188/373] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Jun 18 04:05:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 18 04:05:21.508544 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d169a-9b6f-4336-893c-76df8033a72a None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:21.541869 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 186/374] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Jun 18 04:05:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 04:05:21.549756 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd317ce3-691e-420c-b3a0-47312ec60189 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:21.663927 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd317ce3-691e-420c-b3a0-47312ec60189 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:21.679545 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:21.702536 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2955fe1-6c16-402d-8411-a7a963235def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:21.703407 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2955fe1-6c16-402d-8411-a7a963235def None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:21.703686 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2955fe1-6c16-402d-8411-a7a963235def None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:21.703961 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2955fe1-6c16-402d-8411-a7a963235def None admin] PATH_INFO: `/v3/projects/a7f9d08dadd24d78b125397d1904ae7d` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:21.705319 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2955fe1-6c16-402d-8411-a7a963235def None admin] RBAC: Authorizing `identity:get_project(project_id=a7f9d08dadd24d78b125397d1904ae7d)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:21.706780 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2955fe1-6c16-402d-8411-a7a963235def None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:21.708837 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 187/375] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Jun 18 04:05:21 2022] GET /identity/v3/projects/a7f9d08dadd24d78b125397d1904ae7d => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:21.715013 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2955fe1-6c16-402d-8411-a7a963235def None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:21.826273 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2955fe1-6c16-402d-8411-a7a963235def None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:21.840398 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d169a-9b6f-4336-893c-76df8033a72a None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:21.842313 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:21.866676 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33891b8e-2cae-406e-b9aa-68fe30a40154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:21.867609 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33891b8e-2cae-406e-b9aa-68fe30a40154 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:21.867894 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33891b8e-2cae-406e-b9aa-68fe30a40154 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:21.868173 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33891b8e-2cae-406e-b9aa-68fe30a40154 None admin] PATH_INFO: `/v3/groups/556f5b841fe2406881a0ad69e9c716d0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:21.869751 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33891b8e-2cae-406e-b9aa-68fe30a40154 None admin] RBAC: Authorizing `identity:get_group(group_id=556f5b841fe2406881a0ad69e9c716d0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:21.871210 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33891b8e-2cae-406e-b9aa-68fe30a40154 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:21.873026 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 188/376] 10.222.0.20 () {56 vars in 1180 bytes} [Sat Jun 18 04:05:21 2022] GET /identity/v3/groups/556f5b841fe2406881a0ad69e9c716d0 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:21.879487 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33891b8e-2cae-406e-b9aa-68fe30a40154 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:21.922619 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96552e7-554e-4a1a-a703-3006eb0a81e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:21.924443 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96552e7-554e-4a1a-a703-3006eb0a81e2 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:21.924755 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96552e7-554e-4a1a-a703-3006eb0a81e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:21.926768 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96552e7-554e-4a1a-a703-3006eb0a81e2 None admin] PATH_INFO: `/v3/projects/5c8b5d4bdeea4b829107c59f65874f03` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:21.929109 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96552e7-554e-4a1a-a703-3006eb0a81e2 None admin] RBAC: Authorizing `identity:get_project(project_id=5c8b5d4bdeea4b829107c59f65874f03)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:21.932875 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96552e7-554e-4a1a-a703-3006eb0a81e2 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:21.937320 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 189/377] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Jun 18 04:05:21 2022] GET /identity/v3/projects/5c8b5d4bdeea4b829107c59f65874f03 => generated 344 bytes in 429 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:05:21.943353 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96552e7-554e-4a1a-a703-3006eb0a81e2 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:21.961076 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:22.025235 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33891b8e-2cae-406e-b9aa-68fe30a40154 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:22.064263 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb5d43-e3dc-4e71-aba5-0a987577d618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:22.065409 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb5d43-e3dc-4e71-aba5-0a987577d618 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:22.066114 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb5d43-e3dc-4e71-aba5-0a987577d618 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:22.066605 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb5d43-e3dc-4e71-aba5-0a987577d618 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:22.067593 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bb5d43-e3dc-4e71-aba5-0a987577d618 None admin] RBAC: Adding query filter params (group.id=556f5b841fe2406881a0ad69e9c716d0, role.id=ba29217afc57483a90e90b287c480549, scope.project.id=a7f9d08dadd24d78b125397d1904ae7d) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:22.068054 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bb5d43-e3dc-4e71-aba5-0a987577d618 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:22.069699 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bb5d43-e3dc-4e71-aba5-0a987577d618 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:22.076714 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 189/378] 10.222.0.20 () {56 vars in 1376 bytes} [Sat Jun 18 04:05:21 2022] GET /identity/v3/role_assignments?group.id=556f5b841fe2406881a0ad69e9c716d0&scope.project.id=a7f9d08dadd24d78b125397d1904ae7d&role.id=ba29217afc57483a90e90b287c480549 => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:05:22.156854 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96552e7-554e-4a1a-a703-3006eb0a81e2 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:22.204190 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22c713-7fda-449d-9fbc-cddc3be7e787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:22.205381 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22c713-7fda-449d-9fbc-cddc3be7e787 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:22.205818 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22c713-7fda-449d-9fbc-cddc3be7e787 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:22.206243 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22c713-7fda-449d-9fbc-cddc3be7e787 None admin] PATH_INFO: `/v3/groups/c72c976e6f53491dbd2388b9d023e85a` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:22.213393 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea22c713-7fda-449d-9fbc-cddc3be7e787 None admin] RBAC: Authorizing `identity:get_group(group_id=c72c976e6f53491dbd2388b9d023e85a)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:22.215028 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea22c713-7fda-449d-9fbc-cddc3be7e787 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:22.217274 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 190/379] 10.222.0.20 () {56 vars in 1180 bytes} [Sat Jun 18 04:05:21 2022] GET /identity/v3/groups/c72c976e6f53491dbd2388b9d023e85a => generated 229 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:22.222889 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb5d43-e3dc-4e71-aba5-0a987577d618 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:22.246286 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0b95a-2678-41dc-9b08-e93ceca92c42 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:22.246628 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0b95a-2678-41dc-9b08-e93ceca92c42 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:22.246843 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0b95a-2678-41dc-9b08-e93ceca92c42 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:22.248457 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 191/380] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:05:22.254321 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824df13f-3034-4b9a-8042-8c47c574bd71 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:22.254845 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824df13f-3034-4b9a-8042-8c47c574bd71 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:22.255445 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824df13f-3034-4b9a-8042-8c47c574bd71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:22.282668 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-824df13f-3034-4b9a-8042-8c47c574bd71 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:22.284287 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-824df13f-3034-4b9a-8042-8c47c574bd71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:22.360476 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:22.379683 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb5d43-e3dc-4e71-aba5-0a987577d618 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:22.395674 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:22.420145 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6b08d-41bb-443c-8471-ac6e8405f753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:22.420867 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6b08d-41bb-443c-8471-ac6e8405f753 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:22.421219 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6b08d-41bb-443c-8471-ac6e8405f753 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:22.421589 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6b08d-41bb-443c-8471-ac6e8405f753 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:22.422491 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae6b08d-41bb-443c-8471-ac6e8405f753 None admin] RBAC: Adding query filter params (group.id=c72c976e6f53491dbd2388b9d023e85a, role.id=d783a633c75847d48ef7ef5b169b0313, scope.project.id=5c8b5d4bdeea4b829107c59f65874f03) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:22.422805 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae6b08d-41bb-443c-8471-ac6e8405f753 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:22.422997 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 192/381] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 18 04:05:22.424265 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae6b08d-41bb-443c-8471-ac6e8405f753 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:22.431196 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 190/382] 10.222.0.20 () {56 vars in 1376 bytes} [Sat Jun 18 04:05:22 2022] GET /identity/v3/role_assignments?group.id=c72c976e6f53491dbd2388b9d023e85a&scope.project.id=5c8b5d4bdeea4b829107c59f65874f03&role.id=d783a633c75847d48ef7ef5b169b0313 => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:05:22.468720 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824df13f-3034-4b9a-8042-8c47c574bd71 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:22.585687 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824df13f-3034-4b9a-8042-8c47c574bd71 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:22.628062 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a121b1f-b944-4fc9-8256-7ffb61e82449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:22.628828 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a121b1f-b944-4fc9-8256-7ffb61e82449 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:22.629122 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a121b1f-b944-4fc9-8256-7ffb61e82449 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:22.629371 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a121b1f-b944-4fc9-8256-7ffb61e82449 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:22.648743 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a121b1f-b944-4fc9-8256-7ffb61e82449 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:05:22.656599 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-5a121b1f-b944-4fc9-8256-7ffb61e82449 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 18 04:05:22.656599 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:22.656599 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:22.656599 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:22.656599 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:22.656599 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:22.656599 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:22.656599 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:22.656599 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:22.656599 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:22.656599 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:22.656599 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:22.656599 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:05:22.656599 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:05:22.656599 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:05:22.656599 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:05:22.657681 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:05:22.657681 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:05:22.657681 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:05:22.657681 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:05:22.657681 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:22.657681 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:22.657681 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:22.657681 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:22.657681 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:22.657681 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:22.657681 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:22.657681 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:22.657681 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:22.657681 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:22.657681 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:22.657681 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:22.658656 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:22.658656 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:22.658656 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:22.658656 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:22.658656 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:05:22.658656 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:05:22.658656 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:05:22.658656 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:05:22.658656 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:05:22.658656 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:05:22.658656 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 18 04:05:22.658656 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:05:22.662843 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 193/383] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Jun 18 04:05:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:22.664272 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6b08d-41bb-443c-8471-ac6e8405f753 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:22.780589 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6b08d-41bb-443c-8471-ac6e8405f753 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:22.823460 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d0440-6ff6-4ddc-b5be-4c9fdc81fbbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:22.824164 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d0440-6ff6-4ddc-b5be-4c9fdc81fbbf None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:22.824440 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d0440-6ff6-4ddc-b5be-4c9fdc81fbbf None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:22.824749 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d0440-6ff6-4ddc-b5be-4c9fdc81fbbf None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:22.825518 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335d0440-6ff6-4ddc-b5be-4c9fdc81fbbf None admin] RBAC: Adding query filter params (name=member) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:22.825826 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335d0440-6ff6-4ddc-b5be-4c9fdc81fbbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:22.827296 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335d0440-6ff6-4ddc-b5be-4c9fdc81fbbf None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:22.836959 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 191/384] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Jun 18 04:05:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:22.842917 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a121b1f-b944-4fc9-8256-7ffb61e82449 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:22.877393 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:22.971670 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a121b1f-b944-4fc9-8256-7ffb61e82449 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:23.011134 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10dbf5-224d-4b36-8188-3a8ace25c961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:23.012024 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10dbf5-224d-4b36-8188-3a8ace25c961 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:23.012294 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10dbf5-224d-4b36-8188-3a8ace25c961 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:23.012564 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10dbf5-224d-4b36-8188-3a8ace25c961 None admin] PATH_INFO: `/v3/groups/556f5b841fe2406881a0ad69e9c716d0` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:23.013768 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b10dbf5-224d-4b36-8188-3a8ace25c961 None admin] RBAC: Authorizing `identity:get_group(group_id=556f5b841fe2406881a0ad69e9c716d0)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:23.015222 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b10dbf5-224d-4b36-8188-3a8ace25c961 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:23.016893 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 194/385] 10.222.0.20 () {56 vars in 1180 bytes} [Sat Jun 18 04:05:22 2022] GET /identity/v3/groups/556f5b841fe2406881a0ad69e9c716d0 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:23.022635 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d0440-6ff6-4ddc-b5be-4c9fdc81fbbf None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:23.073926 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:23.148416 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d0440-6ff6-4ddc-b5be-4c9fdc81fbbf None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:23.184616 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438dc763-edcf-4b33-aeaf-36cb2032999b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:23.185510 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438dc763-edcf-4b33-aeaf-36cb2032999b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:23.185784 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438dc763-edcf-4b33-aeaf-36cb2032999b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:23.186055 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438dc763-edcf-4b33-aeaf-36cb2032999b None admin] PATH_INFO: `/v3/projects/594195ae8d4c49c8babdbc7125c60372` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:23.187271 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438dc763-edcf-4b33-aeaf-36cb2032999b None admin] RBAC: Authorizing `identity:get_project(project_id=594195ae8d4c49c8babdbc7125c60372)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:23.189165 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438dc763-edcf-4b33-aeaf-36cb2032999b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:23.192270 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285405e-8c6f-4fc6-b988-c4162603baa4 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:23.192546 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285405e-8c6f-4fc6-b988-c4162603baa4 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:23.192835 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285405e-8c6f-4fc6-b988-c4162603baa4 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:23.193551 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 192/386] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Jun 18 04:05:23 2022] GET /identity/v3/projects/594195ae8d4c49c8babdbc7125c60372 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:23.197826 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 195/387] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 18 04:05:23.199079 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438dc763-edcf-4b33-aeaf-36cb2032999b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:23.205940 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d50412-1722-4cc0-8f25-ebc3bd6e858e None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:23.206237 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d50412-1722-4cc0-8f25-ebc3bd6e858e None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:23.206485 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d50412-1722-4cc0-8f25-ebc3bd6e858e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:23.231583 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-17d50412-1722-4cc0-8f25-ebc3bd6e858e None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:23.232711 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-17d50412-1722-4cc0-8f25-ebc3bd6e858e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:23.364964 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 196/388] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 18 04:05:23.373748 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438dc763-edcf-4b33-aeaf-36cb2032999b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:23.381200 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:23.399280 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d50412-1722-4cc0-8f25-ebc3bd6e858e None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:23.427929 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a658ac5-8104-456b-b39d-048779926a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:23.428866 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a658ac5-8104-456b-b39d-048779926a88 None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:23.429147 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a658ac5-8104-456b-b39d-048779926a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:23.429422 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a658ac5-8104-456b-b39d-048779926a88 None admin] PATH_INFO: `/v3/projects/594195ae8d4c49c8babdbc7125c60372/groups/556f5b841fe2406881a0ad69e9c716d0/roles/d74f7ad64e584e6186564837fa3cf380` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:23.437624 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:23.438423 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a658ac5-8104-456b-b39d-048779926a88 None admin] RBAC: Authorizing `identity:create_grant(project_id=594195ae8d4c49c8babdbc7125c60372, group_id=556f5b841fe2406881a0ad69e9c716d0, role_id=d74f7ad64e584e6186564837fa3cf380)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:23.440100 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a658ac5-8104-456b-b39d-048779926a88 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:23.468603 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 193/389] 10.222.0.20 () {58 vars in 1442 bytes} [Sat Jun 18 04:05:23 2022] PUT /identity/v3/projects/594195ae8d4c49c8babdbc7125c60372/groups/556f5b841fe2406881a0ad69e9c716d0/roles/d74f7ad64e584e6186564837fa3cf380 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 04:05:23.470261 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c0117-45ac-4e96-b353-29323751f2ec None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:23.470557 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c0117-45ac-4e96-b353-29323751f2ec None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:23.470832 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c0117-45ac-4e96-b353-29323751f2ec None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:23.472216 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 194/390] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:05:23.482148 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c26f6-bbb3-4e50-89bc-d2525a4ed7f3 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:23.482334 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c26f6-bbb3-4e50-89bc-d2525a4ed7f3 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:23.482612 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c26f6-bbb3-4e50-89bc-d2525a4ed7f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:23.522333 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-cf6c26f6-bbb3-4e50-89bc-d2525a4ed7f3 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:23.523595 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-cf6c26f6-bbb3-4e50-89bc-d2525a4ed7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:23.567735 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d50412-1722-4cc0-8f25-ebc3bd6e858e None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:23.612720 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2bf42e-82de-4f35-9b6c-89d33ab5932e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:23.613646 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2bf42e-82de-4f35-9b6c-89d33ab5932e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:23.613928 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2bf42e-82de-4f35-9b6c-89d33ab5932e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:23.614415 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2bf42e-82de-4f35-9b6c-89d33ab5932e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:23.626549 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2bf42e-82de-4f35-9b6c-89d33ab5932e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:05:23.635890 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-3b2bf42e-82de-4f35-9b6c-89d33ab5932e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 18 04:05:23.635890 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:23.635890 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:23.635890 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:23.635890 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:23.635890 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:23.635890 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:23.635890 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:23.635890 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:23.635890 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:23.635890 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:23.635890 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:23.635890 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:05:23.635890 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:05:23.635890 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:05:23.635890 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:05:23.636857 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:05:23.636857 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:05:23.636857 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:05:23.636857 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:05:23.636857 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:23.636857 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:23.636857 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:23.636857 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:23.636857 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:23.636857 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:23.636857 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:23.636857 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:23.636857 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:23.636857 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:23.636857 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:23.636857 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:23.637669 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:23.637669 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:23.637669 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:23.637669 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:23.637669 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:05:23.637669 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:05:23.637669 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:05:23.637669 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:05:23.637669 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:05:23.637669 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:05:23.637669 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 18 04:05:23.637669 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:05:23.639636 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 197/391] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Jun 18 04:05:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:23.645397 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2bf42e-82de-4f35-9b6c-89d33ab5932e None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:23.656516 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 195/392] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 18 04:05:23.693525 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6c26f6-bbb3-4e50-89bc-d2525a4ed7f3 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:23.752660 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:23.769622 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2bf42e-82de-4f35-9b6c-89d33ab5932e None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:23.806558 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caca1ca4-656a-4623-9582-cc6367924e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:23.807310 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca1ca4-656a-4623-9582-cc6367924e25 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:23.807851 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca1ca4-656a-4623-9582-cc6367924e25 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:23.807851 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca1ca4-656a-4623-9582-cc6367924e25 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:23.808616 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caca1ca4-656a-4623-9582-cc6367924e25 None admin] RBAC: Adding query filter params (name=member) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:23.808931 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caca1ca4-656a-4623-9582-cc6367924e25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:23.810313 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caca1ca4-656a-4623-9582-cc6367924e25 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:23.819332 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 198/393] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Jun 18 04:05:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:05:23.824758 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caca1ca4-656a-4623-9582-cc6367924e25 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:23.830827 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:23.837945 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6c26f6-bbb3-4e50-89bc-d2525a4ed7f3 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:23.876326 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a00258b-e978-4f5e-b7c1-7b144a2f93b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:23.877877 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00258b-e978-4f5e-b7c1-7b144a2f93b4 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:23.878662 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00258b-e978-4f5e-b7c1-7b144a2f93b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:23.879270 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00258b-e978-4f5e-b7c1-7b144a2f93b4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:23.892389 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a00258b-e978-4f5e-b7c1-7b144a2f93b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:05:23.904227 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-5a00258b-e978-4f5e-b7c1-7b144a2f93b4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 18 04:05:23.904227 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:23.904227 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:23.904227 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:23.904227 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:23.904227 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:23.904227 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:23.904227 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:23.904227 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:23.904227 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:23.904227 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:23.904227 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:23.904227 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:05:23.904227 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:05:23.904227 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:05:23.904227 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:05:23.905368 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:05:23.905368 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:05:23.905368 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:05:23.905368 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:05:23.905368 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:23.905368 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:23.905368 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:23.905368 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:23.905368 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:23.905368 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:23.905368 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:23.905368 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:23.905368 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:23.905368 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:23.905368 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:23.905368 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:23.906354 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:23.906354 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:23.906354 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:23.906354 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:23.906354 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:05:23.906354 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:05:23.906354 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:05:23.906354 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:05:23.906354 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:05:23.906354 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:05:23.906354 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 18 04:05:23.906354 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:23.909226 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 196/394] 10.222.0.20 () {56 vars in 1114 bytes} [Sat Jun 18 04:05:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 04:05:23.917968 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a00258b-e978-4f5e-b7c1-7b144a2f93b4 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:23.976033 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caca1ca4-656a-4623-9582-cc6367924e25 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:24.045595 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b222fc-aec3-4af5-ad56-170814bda53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:24.046447 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b222fc-aec3-4af5-ad56-170814bda53c None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:24.046724 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b222fc-aec3-4af5-ad56-170814bda53c None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:24.046999 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b222fc-aec3-4af5-ad56-170814bda53c None admin] PATH_INFO: `/v3/groups/556f5b841fe2406881a0ad69e9c716d0` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:24.048623 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b222fc-aec3-4af5-ad56-170814bda53c None admin] RBAC: Authorizing `identity:get_group(group_id=556f5b841fe2406881a0ad69e9c716d0)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:24.050094 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b222fc-aec3-4af5-ad56-170814bda53c None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:24.056320 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 199/395] 10.222.0.20 () {56 vars in 1180 bytes} [Sat Jun 18 04:05:23 2022] GET /identity/v3/groups/556f5b841fe2406881a0ad69e9c716d0 => generated 226 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:05:24.075909 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b222fc-aec3-4af5-ad56-170814bda53c None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:24.100945 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:24.112383 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a00258b-e978-4f5e-b7c1-7b144a2f93b4 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:24.146955 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396bc8b-027f-4e64-8490-5cb835c71552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:24.147628 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396bc8b-027f-4e64-8490-5cb835c71552 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:24.147905 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396bc8b-027f-4e64-8490-5cb835c71552 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:24.148176 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396bc8b-027f-4e64-8490-5cb835c71552 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:24.148967 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2396bc8b-027f-4e64-8490-5cb835c71552 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:24.149271 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2396bc8b-027f-4e64-8490-5cb835c71552 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:24.150816 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2396bc8b-027f-4e64-8490-5cb835c71552 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:24.159805 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 197/396] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Jun 18 04:05:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:24.165330 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396bc8b-027f-4e64-8490-5cb835c71552 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:24.186927 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:24.273489 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396bc8b-027f-4e64-8490-5cb835c71552 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:24.300383 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b222fc-aec3-4af5-ad56-170814bda53c None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:24.308647 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7794240a-3eeb-4aa0-8894-feb57ec41893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:24.309562 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794240a-3eeb-4aa0-8894-feb57ec41893 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:24.309877 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794240a-3eeb-4aa0-8894-feb57ec41893 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:24.310155 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794240a-3eeb-4aa0-8894-feb57ec41893 None admin] PATH_INFO: `/v3/groups/556f5b841fe2406881a0ad69e9c716d0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:24.311547 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7794240a-3eeb-4aa0-8894-feb57ec41893 None admin] RBAC: Authorizing `identity:get_group(group_id=556f5b841fe2406881a0ad69e9c716d0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:24.313035 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7794240a-3eeb-4aa0-8894-feb57ec41893 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:24.315045 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 198/397] 10.222.0.20 () {56 vars in 1180 bytes} [Sat Jun 18 04:05:24 2022] GET /identity/v3/groups/556f5b841fe2406881a0ad69e9c716d0 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:05:24.327034 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7794240a-3eeb-4aa0-8894-feb57ec41893 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:24.360805 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04eeabd-f92f-433f-bcd4-7daf05adb1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:24.361675 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04eeabd-f92f-433f-bcd4-7daf05adb1f1 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:24.361947 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04eeabd-f92f-433f-bcd4-7daf05adb1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:24.362212 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04eeabd-f92f-433f-bcd4-7daf05adb1f1 None admin] PATH_INFO: `/v3/projects/a7f9d08dadd24d78b125397d1904ae7d` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:24.369408 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04eeabd-f92f-433f-bcd4-7daf05adb1f1 None admin] RBAC: Authorizing `identity:get_project(project_id=a7f9d08dadd24d78b125397d1904ae7d)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:24.370995 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04eeabd-f92f-433f-bcd4-7daf05adb1f1 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:24.373178 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 200/398] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Jun 18 04:05:24 2022] GET /identity/v3/projects/a7f9d08dadd24d78b125397d1904ae7d => generated 302 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:05:24.380161 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04eeabd-f92f-433f-bcd4-7daf05adb1f1 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:24.421163 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:24.437198 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7794240a-3eeb-4aa0-8894-feb57ec41893 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:24.472538 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69876bd-d853-4672-ab63-81c6a27dc0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:24.473525 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69876bd-d853-4672-ab63-81c6a27dc0b7 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:24.473874 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69876bd-d853-4672-ab63-81c6a27dc0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:24.474217 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69876bd-d853-4672-ab63-81c6a27dc0b7 None admin] PATH_INFO: `/v3/projects/594195ae8d4c49c8babdbc7125c60372` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:24.475846 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69876bd-d853-4672-ab63-81c6a27dc0b7 None admin] RBAC: Authorizing `identity:get_project(project_id=594195ae8d4c49c8babdbc7125c60372)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:24.479320 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69876bd-d853-4672-ab63-81c6a27dc0b7 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:24.479320 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 199/399] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Jun 18 04:05:24 2022] GET /identity/v3/projects/594195ae8d4c49c8babdbc7125c60372 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:05:24.485088 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69876bd-d853-4672-ab63-81c6a27dc0b7 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:24.540435 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:24.586563 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04eeabd-f92f-433f-bcd4-7daf05adb1f1 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:24.592246 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69876bd-d853-4672-ab63-81c6a27dc0b7 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:24.629556 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621a19e-e707-4c6d-b21b-69f7fed3f28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:24.630444 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621a19e-e707-4c6d-b21b-69f7fed3f28f None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:24.630722 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621a19e-e707-4c6d-b21b-69f7fed3f28f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:24.630991 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621a19e-e707-4c6d-b21b-69f7fed3f28f None admin] PATH_INFO: `/v3/projects/594195ae8d4c49c8babdbc7125c60372/groups/556f5b841fe2406881a0ad69e9c716d0/roles/ba29217afc57483a90e90b287c480549` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:24.633264 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8621a19e-e707-4c6d-b21b-69f7fed3f28f None admin] RBAC: Authorizing `identity:create_grant(project_id=594195ae8d4c49c8babdbc7125c60372, group_id=556f5b841fe2406881a0ad69e9c716d0, role_id=ba29217afc57483a90e90b287c480549)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:24.634713 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8621a19e-e707-4c6d-b21b-69f7fed3f28f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:24.649615 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 200/400] 10.222.0.20 () {58 vars in 1442 bytes} [Sat Jun 18 04:05:24 2022] PUT /identity/v3/projects/594195ae8d4c49c8babdbc7125c60372/groups/556f5b841fe2406881a0ad69e9c716d0/roles/ba29217afc57483a90e90b287c480549 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 04:05:24.663874 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71edc210-a2e0-4c3f-bb6a-4ab57bd3e708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:24.664819 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71edc210-a2e0-4c3f-bb6a-4ab57bd3e708 None admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:24.665102 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71edc210-a2e0-4c3f-bb6a-4ab57bd3e708 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:24.665381 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71edc210-a2e0-4c3f-bb6a-4ab57bd3e708 None admin] PATH_INFO: `/v3/projects/a7f9d08dadd24d78b125397d1904ae7d/groups/556f5b841fe2406881a0ad69e9c716d0/roles/d74f7ad64e584e6186564837fa3cf380` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:24.667552 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71edc210-a2e0-4c3f-bb6a-4ab57bd3e708 None admin] RBAC: Authorizing `identity:create_grant(project_id=a7f9d08dadd24d78b125397d1904ae7d, group_id=556f5b841fe2406881a0ad69e9c716d0, role_id=d74f7ad64e584e6186564837fa3cf380)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:24.669130 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71edc210-a2e0-4c3f-bb6a-4ab57bd3e708 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:24.690039 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 201/401] 10.222.0.20 () {58 vars in 1442 bytes} [Sat Jun 18 04:05:24 2022] PUT /identity/v3/projects/a7f9d08dadd24d78b125397d1904ae7d/groups/556f5b841fe2406881a0ad69e9c716d0/roles/d74f7ad64e584e6186564837fa3cf380 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 04:05:25.066858 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad8de1-cea8-4698-b17f-3e35ae308c0e None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:25.067373 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad8de1-cea8-4698-b17f-3e35ae308c0e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:25.067373 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad8de1-cea8-4698-b17f-3e35ae308c0e None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:25.069020 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 201/402] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:05:25.070610 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344aaf9b-f212-40e2-847c-673c8741b063 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:25.070993 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344aaf9b-f212-40e2-847c-673c8741b063 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:25.071174 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344aaf9b-f212-40e2-847c-673c8741b063 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:25.072885 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 202/403] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:05:25.078070 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d4c98-488d-4a14-bae2-0781aade2d1d None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:25.078220 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16dd13-eff0-4a3d-8b2d-5d5d298fd903 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:25.078414 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d4c98-488d-4a14-bae2-0781aade2d1d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:25.078521 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16dd13-eff0-4a3d-8b2d-5d5d298fd903 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:25.078594 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d4c98-488d-4a14-bae2-0781aade2d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:25.078745 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16dd13-eff0-4a3d-8b2d-5d5d298fd903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:25.096282 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-7e16dd13-eff0-4a3d-8b2d-5d5d298fd903 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:25.097510 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-7e16dd13-eff0-4a3d-8b2d-5d5d298fd903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:25.105593 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-997d4c98-488d-4a14-bae2-0781aade2d1d None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:25.106794 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-997d4c98-488d-4a14-bae2-0781aade2d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:25.120498 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:25.213808 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 202/404] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 18 04:05:25.237492 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d4c98-488d-4a14-bae2-0781aade2d1d None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:25.264729 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 203/405] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 18 04:05:25.299440 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e16dd13-eff0-4a3d-8b2d-5d5d298fd903 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:25.368074 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d4c98-488d-4a14-bae2-0781aade2d1d None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:25.410639 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2130ea5-784b-4ea9-970b-4d00e5b82a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:25.411466 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2130ea5-784b-4ea9-970b-4d00e5b82a31 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:25.411742 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2130ea5-784b-4ea9-970b-4d00e5b82a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:25.412014 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2130ea5-784b-4ea9-970b-4d00e5b82a31 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:25.424059 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2130ea5-784b-4ea9-970b-4d00e5b82a31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:05:25.432520 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-f2130ea5-784b-4ea9-970b-4d00e5b82a31 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 18 04:05:25.432520 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:25.432520 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:25.432520 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:25.432520 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:25.432520 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:25.432520 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:25.432520 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:25.432520 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:25.432520 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:25.432520 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:25.432520 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:25.432520 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:05:25.432520 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:05:25.432520 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:05:25.432520 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:05:25.433402 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:05:25.433402 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:05:25.433402 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:05:25.433402 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:05:25.433402 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:25.433402 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:25.433402 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:25.433402 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:25.433402 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:25.433402 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:25.433402 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:25.433402 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:25.433402 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:25.433402 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:25.433402 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:25.433402 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:25.434167 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:25.434167 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:25.434167 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:25.434167 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:25.434167 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:05:25.434167 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:05:25.434167 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:05:25.434167 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:05:25.434167 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:05:25.434167 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:05:25.434167 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 18 04:05:25.434167 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:25.434167 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 203/406] 10.222.0.20 () {56 vars in 1114 bytes} [Sat Jun 18 04:05:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 04:05:25.441373 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2130ea5-784b-4ea9-970b-4d00e5b82a31 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:25.445917 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:25.548389 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2130ea5-784b-4ea9-970b-4d00e5b82a31 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:25.584391 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:25.602639 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e16dd13-eff0-4a3d-8b2d-5d5d298fd903 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:25.605996 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f151bc6d-73d7-40ef-b890-3445b3a4c507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:25.606702 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151bc6d-73d7-40ef-b890-3445b3a4c507 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:25.606982 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151bc6d-73d7-40ef-b890-3445b3a4c507 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:25.607252 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151bc6d-73d7-40ef-b890-3445b3a4c507 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:25.608020 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f151bc6d-73d7-40ef-b890-3445b3a4c507 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:25.608325 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f151bc6d-73d7-40ef-b890-3445b3a4c507 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:25.610179 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f151bc6d-73d7-40ef-b890-3445b3a4c507 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:25.628494 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 204/407] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Jun 18 04:05:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:25.634974 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f151bc6d-73d7-40ef-b890-3445b3a4c507 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:25.651566 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef53024-d212-4500-92d2-b66cbf7dc824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:25.652376 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef53024-d212-4500-92d2-b66cbf7dc824 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:25.652757 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef53024-d212-4500-92d2-b66cbf7dc824 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:25.653594 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef53024-d212-4500-92d2-b66cbf7dc824 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:25.688139 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef53024-d212-4500-92d2-b66cbf7dc824 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:05:25.710724 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-eef53024-d212-4500-92d2-b66cbf7dc824 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 04:05:25.710724 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:25.710724 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:25.710724 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:25.710724 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:25.710724 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:25.710724 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:25.710724 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:25.710724 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:25.710724 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:25.710724 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:25.710724 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:25.710724 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:05:25.710724 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:05:25.710724 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:05:25.710724 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:05:25.711658 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:05:25.711658 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:05:25.711658 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:05:25.711658 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:05:25.711658 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:25.711658 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:25.711658 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:25.711658 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:25.711658 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:25.711658 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:25.711658 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:25.711658 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:25.711658 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:25.711658 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:25.711658 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:25.711658 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:25.712443 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:25.712443 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:25.712443 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:25.712443 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:25.712443 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:05:25.712443 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:05:25.712443 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:05:25.712443 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:05:25.712443 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:05:25.712443 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:05:25.712443 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 04:05:25.712443 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:05:25.712443 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 204/408] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Jun 18 04:05:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 413 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 04:05:25.719458 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef53024-d212-4500-92d2-b66cbf7dc824 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:25.856277 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:25.949062 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f151bc6d-73d7-40ef-b890-3445b3a4c507 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:25.970867 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef53024-d212-4500-92d2-b66cbf7dc824 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:26.018345 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6645f34-4011-4ac1-b460-1e60cbfc1de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:26.019544 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6645f34-4011-4ac1-b460-1e60cbfc1de8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:26.021050 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6645f34-4011-4ac1-b460-1e60cbfc1de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:26.022053 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6645f34-4011-4ac1-b460-1e60cbfc1de8 None admin] PATH_INFO: `/v3/groups/556f5b841fe2406881a0ad69e9c716d0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:26.024070 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6645f34-4011-4ac1-b460-1e60cbfc1de8 None admin] RBAC: Authorizing `identity:get_group(group_id=556f5b841fe2406881a0ad69e9c716d0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:26.026809 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6645f34-4011-4ac1-b460-1e60cbfc1de8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:26.027288 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:26.029755 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 205/409] 10.222.0.20 () {56 vars in 1180 bytes} [Sat Jun 18 04:05:25 2022] GET /identity/v3/groups/556f5b841fe2406881a0ad69e9c716d0 => generated 226 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:26.037506 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6645f34-4011-4ac1-b460-1e60cbfc1de8 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:26.038345 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee818e29-044f-41b9-b88d-b2055e4d8db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:26.039172 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee818e29-044f-41b9-b88d-b2055e4d8db6 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:26.039572 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee818e29-044f-41b9-b88d-b2055e4d8db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:26.039965 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee818e29-044f-41b9-b88d-b2055e4d8db6 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:26.040898 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee818e29-044f-41b9-b88d-b2055e4d8db6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:26.041418 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee818e29-044f-41b9-b88d-b2055e4d8db6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:26.042938 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee818e29-044f-41b9-b88d-b2055e4d8db6 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:26.052381 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 205/410] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Jun 18 04:05:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:26.058005 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee818e29-044f-41b9-b88d-b2055e4d8db6 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:26.163216 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee818e29-044f-41b9-b88d-b2055e4d8db6 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:26.210093 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff1beb-5fd5-4b34-8fce-2bd3e2efee77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:26.211007 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff1beb-5fd5-4b34-8fce-2bd3e2efee77 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:26.211286 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff1beb-5fd5-4b34-8fce-2bd3e2efee77 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:26.211558 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff1beb-5fd5-4b34-8fce-2bd3e2efee77 None admin] PATH_INFO: `/v3/groups/c72c976e6f53491dbd2388b9d023e85a` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:26.213242 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dff1beb-5fd5-4b34-8fce-2bd3e2efee77 None admin] RBAC: Authorizing `identity:get_group(group_id=c72c976e6f53491dbd2388b9d023e85a)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:26.214737 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dff1beb-5fd5-4b34-8fce-2bd3e2efee77 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:26.215078 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6645f34-4011-4ac1-b460-1e60cbfc1de8 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:26.221161 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 206/411] 10.222.0.20 () {56 vars in 1180 bytes} [Sat Jun 18 04:05:26 2022] GET /identity/v3/groups/c72c976e6f53491dbd2388b9d023e85a => generated 229 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:05:26.222491 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274bb771-7fd8-4402-b86c-f2f765e8089f None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:26.222778 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274bb771-7fd8-4402-b86c-f2f765e8089f None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:26.223053 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274bb771-7fd8-4402-b86c-f2f765e8089f None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:26.224587 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 207/412] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:05:26.225295 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274bb771-7fd8-4402-b86c-f2f765e8089f None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:26.250862 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea6524-bc49-457f-ae26-89c43da711f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:26.251782 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea6524-bc49-457f-ae26-89c43da711f2 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:26.252073 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea6524-bc49-457f-ae26-89c43da711f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:26.252324 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea6524-bc49-457f-ae26-89c43da711f2 None admin] PATH_INFO: `/v3/projects/a7f9d08dadd24d78b125397d1904ae7d` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:26.253532 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea6524-bc49-457f-ae26-89c43da711f2 None admin] RBAC: Authorizing `identity:get_project(project_id=a7f9d08dadd24d78b125397d1904ae7d)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:26.255012 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea6524-bc49-457f-ae26-89c43da711f2 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:26.256911 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 206/413] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Jun 18 04:05:26 2022] GET /identity/v3/projects/a7f9d08dadd24d78b125397d1904ae7d => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:26.257929 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e66c18-49c5-4703-a43f-5d3f7c328486 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:26.258262 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e66c18-49c5-4703-a43f-5d3f7c328486 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:26.258537 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e66c18-49c5-4703-a43f-5d3f7c328486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:26.263566 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:26.277529 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-38e66c18-49c5-4703-a43f-5d3f7c328486 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:26.278912 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-38e66c18-49c5-4703-a43f-5d3f7c328486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:26.293026 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:26.334251 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274bb771-7fd8-4402-b86c-f2f765e8089f None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:26.349906 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 207/414] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:05:26.351032 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e66c18-49c5-4703-a43f-5d3f7c328486 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:26.369140 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694cd0e7-dadd-41b5-83f9-120af197334d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:26.370065 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694cd0e7-dadd-41b5-83f9-120af197334d None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:26.370341 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694cd0e7-dadd-41b5-83f9-120af197334d None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:26.370806 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694cd0e7-dadd-41b5-83f9-120af197334d None admin] PATH_INFO: `/v3/projects/5c8b5d4bdeea4b829107c59f65874f03` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:26.371976 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694cd0e7-dadd-41b5-83f9-120af197334d None admin] RBAC: Authorizing `identity:get_project(project_id=5c8b5d4bdeea4b829107c59f65874f03)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:26.373575 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694cd0e7-dadd-41b5-83f9-120af197334d None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:26.375725 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 208/415] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Jun 18 04:05:26 2022] GET /identity/v3/projects/5c8b5d4bdeea4b829107c59f65874f03 => generated 344 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:26.381293 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694cd0e7-dadd-41b5-83f9-120af197334d None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:26.453270 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e66c18-49c5-4703-a43f-5d3f7c328486 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:26.482924 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:26.483782 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694cd0e7-dadd-41b5-83f9-120af197334d None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:26.490723 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8259bb85-87a0-4193-9077-6077c6cd8180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:26.491877 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259bb85-87a0-4193-9077-6077c6cd8180 None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:26.492352 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259bb85-87a0-4193-9077-6077c6cd8180 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:26.492850 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259bb85-87a0-4193-9077-6077c6cd8180 None admin] PATH_INFO: `/v3/projects/a7f9d08dadd24d78b125397d1904ae7d/groups/556f5b841fe2406881a0ad69e9c716d0/roles/ba29217afc57483a90e90b287c480549` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:26.495525 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8259bb85-87a0-4193-9077-6077c6cd8180 None admin] RBAC: Authorizing `identity:create_grant(project_id=a7f9d08dadd24d78b125397d1904ae7d, group_id=556f5b841fe2406881a0ad69e9c716d0, role_id=ba29217afc57483a90e90b287c480549)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:26.497213 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8259bb85-87a0-4193-9077-6077c6cd8180 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:26.511229 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 208/416] 10.222.0.20 () {58 vars in 1442 bytes} [Sat Jun 18 04:05:26 2022] PUT /identity/v3/projects/a7f9d08dadd24d78b125397d1904ae7d/groups/556f5b841fe2406881a0ad69e9c716d0/roles/ba29217afc57483a90e90b287c480549 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 04:05:26.512600 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:26.513794 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8259bb85-87a0-4193-9077-6077c6cd8180 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:26.522583 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b88c5b-d95c-4599-9854-a98c8aeb2ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:26.523403 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b88c5b-d95c-4599-9854-a98c8aeb2ef1 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:26.523729 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b88c5b-d95c-4599-9854-a98c8aeb2ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:26.524007 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b88c5b-d95c-4599-9854-a98c8aeb2ef1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:26.536923 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b88c5b-d95c-4599-9854-a98c8aeb2ef1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:05:26.545510 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-86b88c5b-d95c-4599-9854-a98c8aeb2ef1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 18 04:05:26.545510 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:26.545510 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:26.545510 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:26.545510 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:26.545510 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:26.545510 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:26.545510 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:26.545510 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:26.545510 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:26.545510 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:26.545510 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:26.545510 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:05:26.545510 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:05:26.545510 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:05:26.545510 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:05:26.546493 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:05:26.546493 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:05:26.546493 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:05:26.546493 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:05:26.546493 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:26.546493 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:26.546493 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:26.546493 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:26.546493 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:26.546493 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:26.546493 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:26.546493 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:26.546493 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:26.546493 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:26.546493 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:26.546493 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:26.547290 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:26.547290 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:26.547290 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:26.547290 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:26.547290 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:05:26.547290 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:05:26.547290 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:05:26.547290 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:05:26.547290 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:05:26.547290 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:05:26.547290 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 18 04:05:26.547290 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:05:26.547290 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 209/417] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Jun 18 04:05:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 04:05:26.560055 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b88c5b-d95c-4599-9854-a98c8aeb2ef1 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:26.641433 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8259bb85-87a0-4193-9077-6077c6cd8180 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:26.686925 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ea2b2-a175-4d7d-b766-1b5e9db1a8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:26.688305 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ea2b2-a175-4d7d-b766-1b5e9db1a8cc None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:26.690383 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ea2b2-a175-4d7d-b766-1b5e9db1a8cc None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:26.690861 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ea2b2-a175-4d7d-b766-1b5e9db1a8cc None admin] PATH_INFO: `/v3/projects/5c8b5d4bdeea4b829107c59f65874f03/groups/c72c976e6f53491dbd2388b9d023e85a/roles/d783a633c75847d48ef7ef5b169b0313` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:26.695087 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2ea2b2-a175-4d7d-b766-1b5e9db1a8cc None admin] RBAC: Authorizing `identity:create_grant(project_id=5c8b5d4bdeea4b829107c59f65874f03, group_id=c72c976e6f53491dbd2388b9d023e85a, role_id=d783a633c75847d48ef7ef5b169b0313)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:26.698322 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2ea2b2-a175-4d7d-b766-1b5e9db1a8cc None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:26.724188 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 209/418] 10.222.0.20 () {58 vars in 1442 bytes} [Sat Jun 18 04:05:26 2022] PUT /identity/v3/projects/5c8b5d4bdeea4b829107c59f65874f03/groups/c72c976e6f53491dbd2388b9d023e85a/roles/d783a633c75847d48ef7ef5b169b0313 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 04:05:26.780362 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b88c5b-d95c-4599-9854-a98c8aeb2ef1 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:26.830417 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6665cd6c-4795-4b82-87dd-dd71c48fcdb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:26.831349 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665cd6c-4795-4b82-87dd-dd71c48fcdb3 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:26.831761 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665cd6c-4795-4b82-87dd-dd71c48fcdb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:26.832165 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665cd6c-4795-4b82-87dd-dd71c48fcdb3 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:26.833129 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6665cd6c-4795-4b82-87dd-dd71c48fcdb3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:26.833568 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6665cd6c-4795-4b82-87dd-dd71c48fcdb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:26.835125 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6665cd6c-4795-4b82-87dd-dd71c48fcdb3 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:26.849237 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 210/419] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Jun 18 04:05:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:26.855547 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ea2b2-a175-4d7d-b766-1b5e9db1a8cc None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:26.936118 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:27.009180 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ea2b2-a175-4d7d-b766-1b5e9db1a8cc None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:27.057191 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb9c69f-62d3-4a83-bb18-3af5be20375b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:27.057843 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9c69f-62d3-4a83-bb18-3af5be20375b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:27.058116 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9c69f-62d3-4a83-bb18-3af5be20375b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:27.058383 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9c69f-62d3-4a83-bb18-3af5be20375b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:27.127607 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb9c69f-62d3-4a83-bb18-3af5be20375b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:27.129091 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb9c69f-62d3-4a83-bb18-3af5be20375b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:27.183262 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39fc9f-2f4e-4d56-b07f-fad75fb3a3bb None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:27.183804 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39fc9f-2f4e-4d56-b07f-fad75fb3a3bb None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:27.183804 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39fc9f-2f4e-4d56-b07f-fad75fb3a3bb None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:27.184748 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:27.185504 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 211/420] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 18 04:05:27.187439 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846f3e8-1e2b-4fbd-945f-e720435df37f None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:27.187911 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846f3e8-1e2b-4fbd-945f-e720435df37f None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:27.188270 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846f3e8-1e2b-4fbd-945f-e720435df37f None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:27.190386 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 212/421] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:05:27.195224 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f971db1-a589-4245-8ca5-fabdbddee1a3 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:27.195502 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f971db1-a589-4245-8ca5-fabdbddee1a3 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:27.195777 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f971db1-a589-4245-8ca5-fabdbddee1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:27.214674 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-8f971db1-a589-4245-8ca5-fabdbddee1a3 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:27.215843 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-8f971db1-a589-4245-8ca5-fabdbddee1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:27.242023 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 210/422] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Jun 18 04:05:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 04:05:27.243352 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193aa4f-7615-4e83-bf0f-86e1e79b17e4 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:27.243787 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193aa4f-7615-4e83-bf0f-86e1e79b17e4 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:27.244054 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193aa4f-7615-4e83-bf0f-86e1e79b17e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:27.263243 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-d193aa4f-7615-4e83-bf0f-86e1e79b17e4 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:27.264337 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-d193aa4f-7615-4e83-bf0f-86e1e79b17e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:27.264822 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:27.288851 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 213/423] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:05:27.290186 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f971db1-a589-4245-8ca5-fabdbddee1a3 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:27.352672 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 211/424] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:05:27.353566 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d193aa4f-7615-4e83-bf0f-86e1e79b17e4 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:27.416306 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f971db1-a589-4245-8ca5-fabdbddee1a3 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:27.452905 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414a06a3-07ca-49fa-8879-ab0e8ca86e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:27.453768 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a06a3-07ca-49fa-8879-ab0e8ca86e21 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:27.454037 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a06a3-07ca-49fa-8879-ab0e8ca86e21 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:27.454299 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a06a3-07ca-49fa-8879-ab0e8ca86e21 None admin] PATH_INFO: `/v3/projects/594195ae8d4c49c8babdbc7125c60372` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:27.456185 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414a06a3-07ca-49fa-8879-ab0e8ca86e21 None admin] RBAC: Authorizing `identity:get_project(project_id=594195ae8d4c49c8babdbc7125c60372)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:27.457725 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414a06a3-07ca-49fa-8879-ab0e8ca86e21 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:27.459766 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 214/425] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Jun 18 04:05:27 2022] GET /identity/v3/projects/594195ae8d4c49c8babdbc7125c60372 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:27.460532 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414a06a3-07ca-49fa-8879-ab0e8ca86e21 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:27.468931 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:27.488735 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d193aa4f-7615-4e83-bf0f-86e1e79b17e4 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:27.524270 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf3a5df-d671-4679-8fad-6b5a5f414a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:27.525117 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3a5df-d671-4679-8fad-6b5a5f414a98 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:27.525462 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3a5df-d671-4679-8fad-6b5a5f414a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:27.525835 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3a5df-d671-4679-8fad-6b5a5f414a98 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:27.526212 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:27.537060 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf3a5df-d671-4679-8fad-6b5a5f414a98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:05:27.545482 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-edf3a5df-d671-4679-8fad-6b5a5f414a98 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 18 04:05:27.545482 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:27.545482 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:27.545482 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:27.545482 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:27.545482 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:27.545482 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:27.545482 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:27.545482 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:27.545482 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:27.545482 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:27.545482 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:27.545482 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:05:27.545482 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:05:27.545482 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:05:27.545482 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:05:27.546482 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:05:27.546482 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:05:27.546482 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:05:27.546482 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:05:27.546482 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:27.546482 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:27.546482 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:27.546482 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:27.546482 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:27.546482 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:27.546482 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:27.546482 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:27.546482 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:27.546482 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:27.546482 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:27.546482 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:27.547464 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:27.547464 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:27.547464 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:27.547464 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:27.547464 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:05:27.547464 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:05:27.547464 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:05:27.547464 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:05:27.547464 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:05:27.547464 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:05:27.547464 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 18 04:05:27.547464 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:27.549573 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 212/426] 10.222.0.20 () {56 vars in 1114 bytes} [Sat Jun 18 04:05:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:27.549573 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf3a5df-d671-4679-8fad-6b5a5f414a98 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:27.573310 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414a06a3-07ca-49fa-8879-ab0e8ca86e21 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:27.608176 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07646e-7db4-4d07-9305-722a2a4dc057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:27.609161 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07646e-7db4-4d07-9305-722a2a4dc057 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:27.609883 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07646e-7db4-4d07-9305-722a2a4dc057 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:27.610247 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07646e-7db4-4d07-9305-722a2a4dc057 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:27.620949 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f07646e-7db4-4d07-9305-722a2a4dc057 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:05:27.629001 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-6f07646e-7db4-4d07-9305-722a2a4dc057 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 18 04:05:27.629001 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:27.629001 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:27.629001 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:27.629001 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:27.629001 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:27.629001 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:27.629001 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:27.629001 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:27.629001 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:27.629001 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:27.629001 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:27.629001 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:05:27.629001 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:05:27.629001 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:05:27.629001 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:05:27.630114 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:05:27.630114 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:05:27.630114 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:05:27.630114 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:05:27.630114 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:27.630114 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:27.630114 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:27.630114 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:27.630114 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:27.630114 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:27.630114 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:27.630114 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:27.630114 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:27.630114 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:27.630114 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:27.630114 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:27.631139 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:27.631139 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:27.631139 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:27.631139 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:27.631139 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:05:27.631139 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:05:27.631139 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:05:27.631139 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:05:27.631139 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:05:27.631139 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:05:27.631139 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 18 04:05:27.631139 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:05:27.637674 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 215/427] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Jun 18 04:05:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:27.638636 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07646e-7db4-4d07-9305-722a2a4dc057 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:27.652247 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf3a5df-d671-4679-8fad-6b5a5f414a98 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:27.685967 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3bb22-bd03-4cd0-865a-8cbf7b2b99a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:27.686828 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3bb22-bd03-4cd0-865a-8cbf7b2b99a6 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:27.687099 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3bb22-bd03-4cd0-865a-8cbf7b2b99a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:27.687368 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3bb22-bd03-4cd0-865a-8cbf7b2b99a6 None admin] PATH_INFO: `/v3/groups/556f5b841fe2406881a0ad69e9c716d0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:27.688546 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b3bb22-bd03-4cd0-865a-8cbf7b2b99a6 None admin] RBAC: Authorizing `identity:get_group(group_id=556f5b841fe2406881a0ad69e9c716d0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:27.690039 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b3bb22-bd03-4cd0-865a-8cbf7b2b99a6 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:27.691764 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 213/428] 10.222.0.20 () {56 vars in 1180 bytes} [Sat Jun 18 04:05:27 2022] GET /identity/v3/groups/556f5b841fe2406881a0ad69e9c716d0 => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:27.692514 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3bb22-bd03-4cd0-865a-8cbf7b2b99a6 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:27.707584 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:27.749641 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07646e-7db4-4d07-9305-722a2a4dc057 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:27.769058 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:27.789780 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d94964-f625-46c6-8bca-8513d82edff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:27.790552 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d94964-f625-46c6-8bca-8513d82edff0 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:27.790834 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d94964-f625-46c6-8bca-8513d82edff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:27.791105 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d94964-f625-46c6-8bca-8513d82edff0 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:27.791978 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d94964-f625-46c6-8bca-8513d82edff0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:27.792284 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d94964-f625-46c6-8bca-8513d82edff0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:27.793859 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d94964-f625-46c6-8bca-8513d82edff0 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:27.798144 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3bb22-bd03-4cd0-865a-8cbf7b2b99a6 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:27.802913 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 216/429] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Jun 18 04:05:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:27.803803 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d94964-f625-46c6-8bca-8513d82edff0 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:27.832839 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702b3af-2c2d-4b5e-9266-839971e51b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:27.833511 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702b3af-2c2d-4b5e-9266-839971e51b89 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:27.833785 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702b3af-2c2d-4b5e-9266-839971e51b89 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:27.834053 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702b3af-2c2d-4b5e-9266-839971e51b89 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:27.834805 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2702b3af-2c2d-4b5e-9266-839971e51b89 None admin] RBAC: Adding query filter params (name=member) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:27.835102 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2702b3af-2c2d-4b5e-9266-839971e51b89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:27.836500 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2702b3af-2c2d-4b5e-9266-839971e51b89 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:27.850031 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 214/430] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Jun 18 04:05:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:27.850827 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702b3af-2c2d-4b5e-9266-839971e51b89 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:27.918409 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d94964-f625-46c6-8bca-8513d82edff0 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:27.922655 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:27.953034 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702b3af-2c2d-4b5e-9266-839971e51b89 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:27.957439 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a989715-1540-4ae6-aae1-17b93f2b2769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:27.960405 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a989715-1540-4ae6-aae1-17b93f2b2769 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:27.960711 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a989715-1540-4ae6-aae1-17b93f2b2769 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:27.960985 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a989715-1540-4ae6-aae1-17b93f2b2769 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:27.961829 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a989715-1540-4ae6-aae1-17b93f2b2769 None admin] RBAC: Adding query filter params (group.id=556f5b841fe2406881a0ad69e9c716d0, role.id=d74f7ad64e584e6186564837fa3cf380, scope.project.id=594195ae8d4c49c8babdbc7125c60372) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:27.962231 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a989715-1540-4ae6-aae1-17b93f2b2769 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:27.963818 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a989715-1540-4ae6-aae1-17b93f2b2769 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:27.971282 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 217/431] 10.222.0.20 () {56 vars in 1376 bytes} [Sat Jun 18 04:05:27 2022] GET /identity/v3/role_assignments?group.id=556f5b841fe2406881a0ad69e9c716d0&scope.project.id=594195ae8d4c49c8babdbc7125c60372&role.id=d74f7ad64e584e6186564837fa3cf380 => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:27.972302 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a989715-1540-4ae6-aae1-17b93f2b2769 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:27.988440 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea264630-e765-47e0-adf8-b840da287961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:27.989131 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea264630-e765-47e0-adf8-b840da287961 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:27.989400 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea264630-e765-47e0-adf8-b840da287961 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:27.989669 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea264630-e765-47e0-adf8-b840da287961 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:28.013347 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:28.061255 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea264630-e765-47e0-adf8-b840da287961 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:28.062622 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea264630-e765-47e0-adf8-b840da287961 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:28.091370 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a989715-1540-4ae6-aae1-17b93f2b2769 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:28.130029 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f13ee-0e3b-4b7b-9798-c3785392af47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:28.130785 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f13ee-0e3b-4b7b-9798-c3785392af47 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:28.131067 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f13ee-0e3b-4b7b-9798-c3785392af47 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:28.131339 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f13ee-0e3b-4b7b-9798-c3785392af47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:28.134788 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:28.168656 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 215/432] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Jun 18 04:05:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 04:05:28.174202 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea264630-e765-47e0-adf8-b840da287961 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:28.211090 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684f13ee-0e3b-4b7b-9798-c3785392af47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:28.212754 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684f13ee-0e3b-4b7b-9798-c3785392af47 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:28.275440 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:28.278751 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea264630-e765-47e0-adf8-b840da287961 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:28.316255 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33765c35-a12c-473e-9350-2147b564da4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:28.317064 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33765c35-a12c-473e-9350-2147b564da4e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:28.317335 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33765c35-a12c-473e-9350-2147b564da4e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:28.317597 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33765c35-a12c-473e-9350-2147b564da4e None admin] PATH_INFO: `/v3/projects/594195ae8d4c49c8babdbc7125c60372` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:28.318778 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33765c35-a12c-473e-9350-2147b564da4e None admin] RBAC: Authorizing `identity:get_project(project_id=594195ae8d4c49c8babdbc7125c60372)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:28.320243 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33765c35-a12c-473e-9350-2147b564da4e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:28.323007 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 216/433] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Jun 18 04:05:28 2022] GET /identity/v3/projects/594195ae8d4c49c8babdbc7125c60372 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:05:28.324278 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 218/434] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Jun 18 04:05:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 04:05:28.332355 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33765c35-a12c-473e-9350-2147b564da4e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:28.332676 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f13ee-0e3b-4b7b-9798-c3785392af47 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:28.374878 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:28.433440 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33765c35-a12c-473e-9350-2147b564da4e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:28.441458 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f13ee-0e3b-4b7b-9798-c3785392af47 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:28.470351 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13a328a-86a1-4c9a-9364-5827b9cde858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:28.471275 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a328a-86a1-4c9a-9364-5827b9cde858 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:28.471610 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a328a-86a1-4c9a-9364-5827b9cde858 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:28.471941 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a328a-86a1-4c9a-9364-5827b9cde858 None admin] PATH_INFO: `/v3/groups/556f5b841fe2406881a0ad69e9c716d0` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:28.474187 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13a328a-86a1-4c9a-9364-5827b9cde858 None admin] RBAC: Authorizing `identity:get_group(group_id=556f5b841fe2406881a0ad69e9c716d0)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:28.475718 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13a328a-86a1-4c9a-9364-5827b9cde858 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:28.480104 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddef8eb-1700-4a9a-82e6-7ab684e4ca9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:28.481254 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddef8eb-1700-4a9a-82e6-7ab684e4ca9e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:28.481743 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddef8eb-1700-4a9a-82e6-7ab684e4ca9e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:28.482434 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 217/435] 10.222.0.20 () {56 vars in 1180 bytes} [Sat Jun 18 04:05:28 2022] GET /identity/v3/groups/556f5b841fe2406881a0ad69e9c716d0 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:28.482822 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddef8eb-1700-4a9a-82e6-7ab684e4ca9e None admin] PATH_INFO: `/v3/projects/a7f9d08dadd24d78b125397d1904ae7d` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:28.483287 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13a328a-86a1-4c9a-9364-5827b9cde858 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:28.484934 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddef8eb-1700-4a9a-82e6-7ab684e4ca9e None admin] RBAC: Authorizing `identity:get_project(project_id=a7f9d08dadd24d78b125397d1904ae7d)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:28.486691 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddef8eb-1700-4a9a-82e6-7ab684e4ca9e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:28.489056 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 219/436] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Jun 18 04:05:28 2022] GET /identity/v3/projects/a7f9d08dadd24d78b125397d1904ae7d => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:28.498184 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddef8eb-1700-4a9a-82e6-7ab684e4ca9e None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:28.505351 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:28.635240 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13a328a-86a1-4c9a-9364-5827b9cde858 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:28.641596 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddef8eb-1700-4a9a-82e6-7ab684e4ca9e None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:28.651941 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:28.685752 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7661d-a11d-4a5f-88a8-6f32affbf134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:28.687428 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7661d-a11d-4a5f-88a8-6f32affbf134 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:28.688157 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7661d-a11d-4a5f-88a8-6f32affbf134 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:28.688748 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7661d-a11d-4a5f-88a8-6f32affbf134 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:28.690041 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d7661d-a11d-4a5f-88a8-6f32affbf134 None admin] RBAC: Adding query filter params (group.id=556f5b841fe2406881a0ad69e9c716d0, role.id=ba29217afc57483a90e90b287c480549, scope.project.id=594195ae8d4c49c8babdbc7125c60372) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:28.690738 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d7661d-a11d-4a5f-88a8-6f32affbf134 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:28.691766 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3a445-a5b1-4a43-bcad-070e984861b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:28.692654 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3a445-a5b1-4a43-bcad-070e984861b9 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:28.692932 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3a445-a5b1-4a43-bcad-070e984861b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:28.693199 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3a445-a5b1-4a43-bcad-070e984861b9 None admin] PATH_INFO: `/v3/groups/556f5b841fe2406881a0ad69e9c716d0` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:28.693563 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d7661d-a11d-4a5f-88a8-6f32affbf134 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:28.694400 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c3a445-a5b1-4a43-bcad-070e984861b9 None admin] RBAC: Authorizing `identity:get_group(group_id=556f5b841fe2406881a0ad69e9c716d0)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:28.696122 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c3a445-a5b1-4a43-bcad-070e984861b9 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:28.698811 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 220/437] 10.222.0.20 () {56 vars in 1180 bytes} [Sat Jun 18 04:05:28 2022] GET /identity/v3/groups/556f5b841fe2406881a0ad69e9c716d0 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:28.703173 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 218/438] 10.222.0.20 () {56 vars in 1376 bytes} [Sat Jun 18 04:05:28 2022] GET /identity/v3/role_assignments?group.id=556f5b841fe2406881a0ad69e9c716d0&scope.project.id=594195ae8d4c49c8babdbc7125c60372&role.id=ba29217afc57483a90e90b287c480549 => generated 611 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:28.711793 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3a445-a5b1-4a43-bcad-070e984861b9 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:28.803329 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:28.840512 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3a445-a5b1-4a43-bcad-070e984861b9 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:28.883153 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0dbcda-3947-4441-8d81-2d4415dd77ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:28.884220 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0dbcda-3947-4441-8d81-2d4415dd77ad None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:28.884736 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0dbcda-3947-4441-8d81-2d4415dd77ad None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:28.885348 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0dbcda-3947-4441-8d81-2d4415dd77ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:28.886373 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0dbcda-3947-4441-8d81-2d4415dd77ad None admin] RBAC: Adding query filter params (group.id=556f5b841fe2406881a0ad69e9c716d0, role.id=d74f7ad64e584e6186564837fa3cf380, scope.project.id=a7f9d08dadd24d78b125397d1904ae7d) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:28.886867 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0dbcda-3947-4441-8d81-2d4415dd77ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:28.888523 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0dbcda-3947-4441-8d81-2d4415dd77ad None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:28.895710 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 221/439] 10.222.0.20 () {56 vars in 1376 bytes} [Sat Jun 18 04:05:28 2022] GET /identity/v3/role_assignments?group.id=556f5b841fe2406881a0ad69e9c716d0&scope.project.id=a7f9d08dadd24d78b125397d1904ae7d&role.id=d74f7ad64e584e6186564837fa3cf380 => generated 611 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:29.074779 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e094fb-fe8d-4de5-ba16-cd03c05469cd None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:29.075108 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e094fb-fe8d-4de5-ba16-cd03c05469cd None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:29.075328 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e094fb-fe8d-4de5-ba16-cd03c05469cd None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:29.077245 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 219/440] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:05:29.082417 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1fc44-d4c5-4a9c-ac00-359f27ef9d87 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:29.082707 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1fc44-d4c5-4a9c-ac00-359f27ef9d87 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:29.082982 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1fc44-d4c5-4a9c-ac00-359f27ef9d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:29.101601 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-93a1fc44-d4c5-4a9c-ac00-359f27ef9d87 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:29.102782 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-93a1fc44-d4c5-4a9c-ac00-359f27ef9d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:29.174083 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126411d0-dd77-4c57-944e-b689cca58e34 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:29.174262 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126411d0-dd77-4c57-944e-b689cca58e34 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:29.174528 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126411d0-dd77-4c57-944e-b689cca58e34 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:29.176312 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 220/441] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:05:29.177206 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 222/442] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 18 04:05:29.181268 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e845467-40b5-4641-a1e4-31a242021c88 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:29.181389 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e845467-40b5-4641-a1e4-31a242021c88 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:29.181649 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e845467-40b5-4641-a1e4-31a242021c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:29.200424 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1fc44-d4c5-4a9c-ac00-359f27ef9d87 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:29.201082 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-5e845467-40b5-4641-a1e4-31a242021c88 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:29.202274 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-5e845467-40b5-4641-a1e4-31a242021c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:29.276950 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:29.292418 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 221/443] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:05:29.316975 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e845467-40b5-4641-a1e4-31a242021c88 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:29.325377 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1fc44-d4c5-4a9c-ac00-359f27ef9d87 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:29.361368 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d039450b-daeb-447d-9289-b4d53021c494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:29.362412 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039450b-daeb-447d-9289-b4d53021c494 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:29.362825 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039450b-daeb-447d-9289-b4d53021c494 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:29.363250 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039450b-daeb-447d-9289-b4d53021c494 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:29.374075 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d039450b-daeb-447d-9289-b4d53021c494 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:05:29.383044 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-d039450b-daeb-447d-9289-b4d53021c494 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 18 04:05:29.383044 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:29.383044 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:29.383044 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:29.383044 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:29.383044 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:29.383044 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:29.383044 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:29.383044 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:29.383044 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:29.383044 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:29.383044 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:29.383044 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:05:29.383044 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:05:29.383044 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:05:29.383044 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:05:29.384008 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:05:29.384008 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:05:29.384008 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:05:29.384008 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:05:29.384008 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:29.384008 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:29.384008 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:29.384008 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:29.384008 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:29.384008 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:29.384008 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:29.384008 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:29.384008 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:29.384008 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:29.384008 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:29.384008 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:29.385124 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:29.385124 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:29.385124 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:29.385124 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:29.385124 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:05:29.385124 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:05:29.385124 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:05:29.385124 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:05:29.385124 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:05:29.385124 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:05:29.385124 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 18 04:05:29.385124 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:05:29.385124 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 223/444] 10.222.0.20 () {56 vars in 1114 bytes} [Sat Jun 18 04:05:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 04:05:29.390017 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d039450b-daeb-447d-9289-b4d53021c494 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:29.431135 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e845467-40b5-4641-a1e4-31a242021c88 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:29.432602 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:29.466922 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f84441-0f90-4eeb-bfe4-40e79959534c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:29.467723 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f84441-0f90-4eeb-bfe4-40e79959534c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:29.468001 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f84441-0f90-4eeb-bfe4-40e79959534c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:29.468274 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f84441-0f90-4eeb-bfe4-40e79959534c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:29.478189 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f84441-0f90-4eeb-bfe4-40e79959534c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:05:29.486267 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-21f84441-0f90-4eeb-bfe4-40e79959534c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 04:05:29.486267 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:29.486267 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:29.486267 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:29.486267 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:29.486267 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:29.486267 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:29.486267 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:29.486267 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:29.486267 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:29.486267 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:29.486267 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:29.486267 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:05:29.486267 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:05:29.486267 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:05:29.486267 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:05:29.487302 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:05:29.487302 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:05:29.487302 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:05:29.487302 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:05:29.487302 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:29.487302 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:29.487302 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:29.487302 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:29.487302 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:29.487302 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:29.487302 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:29.487302 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:29.487302 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:29.487302 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:29.487302 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:29.487302 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:29.488125 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:29.488125 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:29.488125 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:29.488125 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:29.488125 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:05:29.488125 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:05:29.488125 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:05:29.488125 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:05:29.488125 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:05:29.488125 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:05:29.488125 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 04:05:29.488125 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:29.488749 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d039450b-daeb-447d-9289-b4d53021c494 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:29.488820 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 222/445] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Jun 18 04:05:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:29.493215 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f84441-0f90-4eeb-bfe4-40e79959534c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:29.510164 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:29.521224 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae02432e-b018-4743-b94d-95f4ece8d3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:29.521870 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02432e-b018-4743-b94d-95f4ece8d3a0 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:29.522152 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02432e-b018-4743-b94d-95f4ece8d3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:29.522420 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02432e-b018-4743-b94d-95f4ece8d3a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:29.523164 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae02432e-b018-4743-b94d-95f4ece8d3a0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:29.523461 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae02432e-b018-4743-b94d-95f4ece8d3a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:29.524858 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae02432e-b018-4743-b94d-95f4ece8d3a0 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:29.533125 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 224/446] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Jun 18 04:05:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:05:29.538269 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae02432e-b018-4743-b94d-95f4ece8d3a0 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:29.592705 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f84441-0f90-4eeb-bfe4-40e79959534c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:29.635200 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d130ba65-7f5f-4caa-baf8-5a6b6761092f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:29.635864 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130ba65-7f5f-4caa-baf8-5a6b6761092f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:29.636140 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130ba65-7f5f-4caa-baf8-5a6b6761092f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:29.636428 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130ba65-7f5f-4caa-baf8-5a6b6761092f None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:29.637193 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d130ba65-7f5f-4caa-baf8-5a6b6761092f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:29.637494 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d130ba65-7f5f-4caa-baf8-5a6b6761092f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:29.638896 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d130ba65-7f5f-4caa-baf8-5a6b6761092f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:29.643380 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae02432e-b018-4743-b94d-95f4ece8d3a0 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:29.648390 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 223/447] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Jun 18 04:05:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:05:29.654063 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d130ba65-7f5f-4caa-baf8-5a6b6761092f None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:29.675492 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a807c-2b19-4f35-b5f3-effecb693b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:29.676133 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a807c-2b19-4f35-b5f3-effecb693b91 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:29.676409 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a807c-2b19-4f35-b5f3-effecb693b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:29.676746 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a807c-2b19-4f35-b5f3-effecb693b91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:29.680238 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:29.731392 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:29.745863 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a807c-2b19-4f35-b5f3-effecb693b91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:29.747405 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a807c-2b19-4f35-b5f3-effecb693b91 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:29.754897 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d130ba65-7f5f-4caa-baf8-5a6b6761092f None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:29.788796 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec227ad4-341d-4e40-98e2-65804366445a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:29.789436 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec227ad4-341d-4e40-98e2-65804366445a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:29.789712 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec227ad4-341d-4e40-98e2-65804366445a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:29.789977 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec227ad4-341d-4e40-98e2-65804366445a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:29.843505 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 225/448] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Jun 18 04:05:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 04:05:29.849160 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a807c-2b19-4f35-b5f3-effecb693b91 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:29.854568 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec227ad4-341d-4e40-98e2-65804366445a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:29.856030 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec227ad4-341d-4e40-98e2-65804366445a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:29.879698 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:29.934339 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:29.950171 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a807c-2b19-4f35-b5f3-effecb693b91 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:29.960704 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 224/449] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Jun 18 04:05:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 04:05:29.966589 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec227ad4-341d-4e40-98e2-65804366445a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:29.985747 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b681fb69-d367-4f7e-9be7-60ed94ee96f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:29.986918 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681fb69-d367-4f7e-9be7-60ed94ee96f0 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:29.987323 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681fb69-d367-4f7e-9be7-60ed94ee96f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:29.987719 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681fb69-d367-4f7e-9be7-60ed94ee96f0 None admin] PATH_INFO: `/v3/projects/a7f9d08dadd24d78b125397d1904ae7d` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:29.989317 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b681fb69-d367-4f7e-9be7-60ed94ee96f0 None admin] RBAC: Authorizing `identity:get_project(project_id=a7f9d08dadd24d78b125397d1904ae7d)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:29.990778 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b681fb69-d367-4f7e-9be7-60ed94ee96f0 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:29.992463 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 226/450] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Jun 18 04:05:29 2022] GET /identity/v3/projects/a7f9d08dadd24d78b125397d1904ae7d => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:29.998013 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b681fb69-d367-4f7e-9be7-60ed94ee96f0 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:30.070013 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec227ad4-341d-4e40-98e2-65804366445a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:30.093039 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:30.094175 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b681fb69-d367-4f7e-9be7-60ed94ee96f0 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:30.104407 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd86b2-21f6-4bd9-b4d8-6d1a9c326abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:30.105292 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd86b2-21f6-4bd9-b4d8-6d1a9c326abc None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:30.105560 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd86b2-21f6-4bd9-b4d8-6d1a9c326abc None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:30.105820 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd86b2-21f6-4bd9-b4d8-6d1a9c326abc None admin] PATH_INFO: `/v3/projects/5c8b5d4bdeea4b829107c59f65874f03` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:30.107001 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fd86b2-21f6-4bd9-b4d8-6d1a9c326abc None admin] RBAC: Authorizing `identity:get_project(project_id=5c8b5d4bdeea4b829107c59f65874f03)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:30.108438 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fd86b2-21f6-4bd9-b4d8-6d1a9c326abc None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:30.110529 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 225/451] 10.222.0.20 () {56 vars in 1186 bytes} [Sat Jun 18 04:05:29 2022] GET /identity/v3/projects/5c8b5d4bdeea4b829107c59f65874f03 => generated 344 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:30.115897 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd86b2-21f6-4bd9-b4d8-6d1a9c326abc None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:30.128078 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b97c40-6ef9-43a5-9abf-d01d904b7993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:30.128970 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b97c40-6ef9-43a5-9abf-d01d904b7993 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:30.129250 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b97c40-6ef9-43a5-9abf-d01d904b7993 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:30.129521 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b97c40-6ef9-43a5-9abf-d01d904b7993 None admin] PATH_INFO: `/v3/groups/556f5b841fe2406881a0ad69e9c716d0` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:30.130748 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b97c40-6ef9-43a5-9abf-d01d904b7993 None admin] RBAC: Authorizing `identity:get_group(group_id=556f5b841fe2406881a0ad69e9c716d0)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:30.132168 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b97c40-6ef9-43a5-9abf-d01d904b7993 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:30.133847 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 227/452] 10.222.0.20 () {56 vars in 1180 bytes} [Sat Jun 18 04:05:29 2022] GET /identity/v3/groups/556f5b841fe2406881a0ad69e9c716d0 => generated 226 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:05:30.139549 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b97c40-6ef9-43a5-9abf-d01d904b7993 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:30.162456 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:30.216671 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd86b2-21f6-4bd9-b4d8-6d1a9c326abc None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:30.239623 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b97c40-6ef9-43a5-9abf-d01d904b7993 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:30.250495 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85408211-588e-436b-997e-6d42e2bd8a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:30.251353 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85408211-588e-436b-997e-6d42e2bd8a01 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:30.251627 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85408211-588e-436b-997e-6d42e2bd8a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:30.251895 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85408211-588e-436b-997e-6d42e2bd8a01 None admin] PATH_INFO: `/v3/groups/c72c976e6f53491dbd2388b9d023e85a` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:30.253143 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85408211-588e-436b-997e-6d42e2bd8a01 None admin] RBAC: Authorizing `identity:get_group(group_id=c72c976e6f53491dbd2388b9d023e85a)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:30.254609 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85408211-588e-436b-997e-6d42e2bd8a01 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:30.256269 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 226/453] 10.222.0.20 () {56 vars in 1180 bytes} [Sat Jun 18 04:05:30 2022] GET /identity/v3/groups/c72c976e6f53491dbd2388b9d023e85a => generated 229 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:30.262119 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85408211-588e-436b-997e-6d42e2bd8a01 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:30.274286 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e385503b-00c3-4ad9-82b9-27540af734c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:30.274933 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385503b-00c3-4ad9-82b9-27540af734c5 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:30.275207 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385503b-00c3-4ad9-82b9-27540af734c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:30.275501 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385503b-00c3-4ad9-82b9-27540af734c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:30.276327 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e385503b-00c3-4ad9-82b9-27540af734c5 None admin] RBAC: Adding query filter params (group.id=556f5b841fe2406881a0ad69e9c716d0, role.id=ba29217afc57483a90e90b287c480549, scope.project.id=a7f9d08dadd24d78b125397d1904ae7d) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:30.276664 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e385503b-00c3-4ad9-82b9-27540af734c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:30.278085 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e385503b-00c3-4ad9-82b9-27540af734c5 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:30.283831 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 228/454] 10.222.0.20 () {56 vars in 1376 bytes} [Sat Jun 18 04:05:30 2022] GET /identity/v3/role_assignments?group.id=556f5b841fe2406881a0ad69e9c716d0&scope.project.id=a7f9d08dadd24d78b125397d1904ae7d&role.id=ba29217afc57483a90e90b287c480549 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:05:30.323848 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:30.370750 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85408211-588e-436b-997e-6d42e2bd8a01 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:30.408358 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a813ca74-d846-4424-8482-6fa05794148d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:30.409060 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813ca74-d846-4424-8482-6fa05794148d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:30.409340 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813ca74-d846-4424-8482-6fa05794148d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:30.409614 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813ca74-d846-4424-8482-6fa05794148d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:30.410474 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a813ca74-d846-4424-8482-6fa05794148d None admin] RBAC: Adding query filter params (group.id=c72c976e6f53491dbd2388b9d023e85a, role.id=d783a633c75847d48ef7ef5b169b0313, scope.project.id=5c8b5d4bdeea4b829107c59f65874f03) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:30.410786 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a813ca74-d846-4424-8482-6fa05794148d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:30.412257 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a813ca74-d846-4424-8482-6fa05794148d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:30.419191 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 227/455] 10.222.0.20 () {56 vars in 1376 bytes} [Sat Jun 18 04:05:30 2022] GET /identity/v3/role_assignments?group.id=c72c976e6f53491dbd2388b9d023e85a&scope.project.id=5c8b5d4bdeea4b829107c59f65874f03&role.id=d783a633c75847d48ef7ef5b169b0313 => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:32.933986 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc9ce6-0db3-46a6-aa13-cc70b4fc2244 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:32.935259 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc9ce6-0db3-46a6-aa13-cc70b4fc2244 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:32.936027 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc9ce6-0db3-46a6-aa13-cc70b4fc2244 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:32.938875 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 229/456] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:05:32.944781 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbcd4a-3b02-49ee-a135-69264eee5d4d None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:32.945644 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbcd4a-3b02-49ee-a135-69264eee5d4d None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:32.946134 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbcd4a-3b02-49ee-a135-69264eee5d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:32.973673 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-03bbcd4a-3b02-49ee-a135-69264eee5d4d None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:32.974874 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-03bbcd4a-3b02-49ee-a135-69264eee5d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:33.006407 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d11acb-247c-435f-8b2e-0675003e4f01 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:33.007098 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d11acb-247c-435f-8b2e-0675003e4f01 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:33.007639 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d11acb-247c-435f-8b2e-0675003e4f01 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:33.010028 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 230/457] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:05:33.016214 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003c9ab-274a-4aba-b13c-d5ca8662eff3 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:33.016893 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003c9ab-274a-4aba-b13c-d5ca8662eff3 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:33.017353 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003c9ab-274a-4aba-b13c-d5ca8662eff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:33.049255 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-6003c9ab-274a-4aba-b13c-d5ca8662eff3 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:33.050786 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-6003c9ab-274a-4aba-b13c-d5ca8662eff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:33.094287 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 228/458] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 18 04:05:33.148655 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 231/459] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 18 04:05:33.153121 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bbcd4a-3b02-49ee-a135-69264eee5d4d None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:33.185754 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6003c9ab-274a-4aba-b13c-d5ca8662eff3 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:33.211976 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:33.232615 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:33.279272 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bbcd4a-3b02-49ee-a135-69264eee5d4d None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:33.314764 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74792150-05e8-4397-9ed5-32174448fbb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:33.315804 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74792150-05e8-4397-9ed5-32174448fbb4 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:33.316248 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74792150-05e8-4397-9ed5-32174448fbb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:33.316690 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74792150-05e8-4397-9ed5-32174448fbb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:33.329881 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74792150-05e8-4397-9ed5-32174448fbb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:33.332643 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74792150-05e8-4397-9ed5-32174448fbb4 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:33.334290 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6003c9ab-274a-4aba-b13c-d5ca8662eff3 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:33.354726 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-74792150-05e8-4397-9ed5-32174448fbb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:33.354726 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:33.354726 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:33.354726 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:33.354726 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:33.354726 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:33.354726 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:33.354726 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:33.354726 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:33.354726 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:33.354726 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:33.354726 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:33.354726 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:05:33.354726 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:05:33.354726 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:05:33.355622 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:05:33.355622 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:33.355622 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:33.355622 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:33.355622 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:33.355622 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:33.355622 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:33.355622 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:33.355622 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:33.355622 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:33.355622 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:33.355622 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:33.355622 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:33.355622 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:33.355622 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:33.355622 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:33.355622 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:33.356460 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:05:33.356460 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:05:33.356460 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:33.356460 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:33.366273 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 229/460] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:05:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:33.366273 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2af5e-acad-457a-9952-435822ad3377 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:33.366273 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2af5e-acad-457a-9952-435822ad3377 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:33.366273 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2af5e-acad-457a-9952-435822ad3377 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:33.366273 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 230/461] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:05:33.367910 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2e425-f252-4af7-a3b3-529fbe865594 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:33.368383 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2e425-f252-4af7-a3b3-529fbe865594 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:33.368984 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2e425-f252-4af7-a3b3-529fbe865594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:33.380291 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719ce4d2-c001-498f-a3fc-8cd039bc681b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:33.381134 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ce4d2-c001-498f-a3fc-8cd039bc681b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:33.381561 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ce4d2-c001-498f-a3fc-8cd039bc681b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:33.381970 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ce4d2-c001-498f-a3fc-8cd039bc681b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:33.387129 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-45b2e425-f252-4af7-a3b3-529fbe865594 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:33.388404 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-45b2e425-f252-4af7-a3b3-529fbe865594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:33.393285 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719ce4d2-c001-498f-a3fc-8cd039bc681b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:33.394913 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719ce4d2-c001-498f-a3fc-8cd039bc681b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:33.414821 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-719ce4d2-c001-498f-a3fc-8cd039bc681b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:33.414821 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:33.414821 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:33.414821 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:33.414821 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:33.414821 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:33.414821 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:33.414821 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:33.414821 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:33.414821 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:33.414821 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:33.414821 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:33.414821 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:05:33.414821 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:05:33.414821 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:05:33.415921 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:05:33.415921 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:33.415921 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:33.415921 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:33.415921 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:33.415921 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:33.415921 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:33.415921 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:33.415921 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:33.415921 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:33.415921 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:33.415921 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:33.415921 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:33.415921 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:33.415921 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:33.415921 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:33.415921 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:33.417087 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:05:33.417087 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:05:33.417087 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:33.417087 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:05:33.418680 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 232/462] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:05:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 04:05:33.419813 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719ce4d2-c001-498f-a3fc-8cd039bc681b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:33.480596 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 231/463] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:05:33.480596 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2e425-f252-4af7-a3b3-529fbe865594 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:33.510048 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:33.512938 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:33.551231 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719ce4d2-c001-498f-a3fc-8cd039bc681b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:33.584539 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2e425-f252-4af7-a3b3-529fbe865594 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:33.595712 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b35fc8-59ac-462b-bcb5-2401ad2c272a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:33.596902 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b35fc8-59ac-462b-bcb5-2401ad2c272a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:33.597380 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b35fc8-59ac-462b-bcb5-2401ad2c272a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:33.597851 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b35fc8-59ac-462b-bcb5-2401ad2c272a None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:33.598654 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b35fc8-59ac-462b-bcb5-2401ad2c272a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:33.599020 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b35fc8-59ac-462b-bcb5-2401ad2c272a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:33.601036 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b35fc8-59ac-462b-bcb5-2401ad2c272a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:33.626028 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f651f-7c65-460b-97c2-4bef9aafa6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:33.627046 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f651f-7c65-460b-97c2-4bef9aafa6a0 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:33.627474 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f651f-7c65-460b-97c2-4bef9aafa6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:33.627932 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f651f-7c65-460b-97c2-4bef9aafa6a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:33.628841 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312f651f-7c65-460b-97c2-4bef9aafa6a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:33.629343 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312f651f-7c65-460b-97c2-4bef9aafa6a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:33.630628 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 233/464] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:05:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:33.631446 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312f651f-7c65-460b-97c2-4bef9aafa6a0 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:33.631667 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b35fc8-59ac-462b-bcb5-2401ad2c272a None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:33.648701 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 232/465] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:05:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:33.649859 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f651f-7c65-460b-97c2-4bef9aafa6a0 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:33.760363 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b35fc8-59ac-462b-bcb5-2401ad2c272a None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:33.761474 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:33.768076 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f651f-7c65-460b-97c2-4bef9aafa6a0 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:33.787807 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:33.796829 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc289e8-3bf7-44d2-a66d-425d41df7523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:33.797619 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc289e8-3bf7-44d2-a66d-425d41df7523 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:33.797913 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc289e8-3bf7-44d2-a66d-425d41df7523 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:33.798159 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc289e8-3bf7-44d2-a66d-425d41df7523 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:33.803499 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc4a2a-035b-4f7f-abc5-65f1894f27be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:33.804170 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc4a2a-035b-4f7f-abc5-65f1894f27be None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:33.804447 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc4a2a-035b-4f7f-abc5-65f1894f27be None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:33.804760 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc4a2a-035b-4f7f-abc5-65f1894f27be None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:33.805459 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddc4a2a-035b-4f7f-abc5-65f1894f27be None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:33.806953 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddc4a2a-035b-4f7f-abc5-65f1894f27be None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:33.808531 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc289e8-3bf7-44d2-a66d-425d41df7523 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:33.810009 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc289e8-3bf7-44d2-a66d-425d41df7523 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:33.826978 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 233/466] 10.222.0.20 () {60 vars in 1132 bytes} [Sat Jun 18 04:05:33 2022] POST /identity/v3/users => generated 248 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 04:05:33.827771 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc4a2a-035b-4f7f-abc5-65f1894f27be None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:33.830462 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-dbc289e8-3bf7-44d2-a66d-425d41df7523 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:33.830462 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:33.830462 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:33.830462 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:33.830462 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:33.830462 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:33.830462 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:33.830462 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:33.830462 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:33.830462 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:33.830462 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:33.830462 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:33.830462 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:05:33.830462 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:05:33.830462 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:05:33.831287 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:05:33.831287 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:33.831287 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:33.831287 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:33.831287 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:33.831287 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:33.831287 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:33.831287 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:33.831287 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:33.831287 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:33.831287 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:33.831287 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:33.831287 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:33.831287 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:33.831287 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:33.831287 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:33.831287 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:33.832116 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:05:33.832116 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:05:33.832116 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:33.832116 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:05:33.839040 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 234/467] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:05:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:33.839040 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b069e15-a964-4a2c-b075-5c0c90196a23 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:33.839040 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b069e15-a964-4a2c-b075-5c0c90196a23 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:33.839040 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b069e15-a964-4a2c-b075-5c0c90196a23 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:33.840713 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 235/468] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:05:33.841835 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b069e15-a964-4a2c-b075-5c0c90196a23 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:33.965766 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc4a2a-035b-4f7f-abc5-65f1894f27be None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:33.978778 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b069e15-a964-4a2c-b075-5c0c90196a23 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:34.010153 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b16955-2dd3-47f7-b0e4-fabbbfa1a021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:34.011245 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b16955-2dd3-47f7-b0e4-fabbbfa1a021 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:34.011737 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b16955-2dd3-47f7-b0e4-fabbbfa1a021 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:34.012216 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b16955-2dd3-47f7-b0e4-fabbbfa1a021 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:34.013089 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b16955-2dd3-47f7-b0e4-fabbbfa1a021 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:34.014668 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b16955-2dd3-47f7-b0e4-fabbbfa1a021 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:34.018705 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a631c-40ec-4f71-abf1-4c40d223f0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:34.019378 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a631c-40ec-4f71-abf1-4c40d223f0c1 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:34.019650 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a631c-40ec-4f71-abf1-4c40d223f0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:34.019922 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a631c-40ec-4f71-abf1-4c40d223f0c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:34.020686 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9a631c-40ec-4f71-abf1-4c40d223f0c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:34.020993 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9a631c-40ec-4f71-abf1-4c40d223f0c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:34.022368 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9a631c-40ec-4f71-abf1-4c40d223f0c1 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:34.036118 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 236/469] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:05:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:34.037840 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd92083-0225-4828-b1ce-8c6701bf1d00 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:34.038142 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd92083-0225-4828-b1ce-8c6701bf1d00 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:34.038382 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd92083-0225-4828-b1ce-8c6701bf1d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:34.049296 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 234/470] 10.222.0.20 () {60 vars in 1132 bytes} [Sat Jun 18 04:05:33 2022] POST /identity/v3/users => generated 246 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 04:05:34.050104 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b16955-2dd3-47f7-b0e4-fabbbfa1a021 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:34.061621 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-dbd92083-0225-4828-b1ce-8c6701bf1d00 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:34.062541 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:34.064404 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-dbd92083-0225-4828-b1ce-8c6701bf1d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:34.111493 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:34.150133 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 237/471] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:05:34.175876 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd92083-0225-4828-b1ce-8c6701bf1d00 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:34.177273 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b16955-2dd3-47f7-b0e4-fabbbfa1a021 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:34.217087 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83873c40-b76c-4f99-9ff1-0d1bc17896ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:34.217740 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83873c40-b76c-4f99-9ff1-0d1bc17896ad None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:34.218188 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83873c40-b76c-4f99-9ff1-0d1bc17896ad None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:34.218523 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83873c40-b76c-4f99-9ff1-0d1bc17896ad None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:34.219303 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83873c40-b76c-4f99-9ff1-0d1bc17896ad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:34.220893 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83873c40-b76c-4f99-9ff1-0d1bc17896ad None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:34.251762 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 235/472] 10.222.0.20 () {60 vars in 1132 bytes} [Sat Jun 18 04:05:34 2022] POST /identity/v3/users => generated 248 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 04:05:34.295121 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd92083-0225-4828-b1ce-8c6701bf1d00 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:34.335632 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54540a0-cab2-40cf-b2bb-b8b7e3a7650e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:34.336811 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54540a0-cab2-40cf-b2bb-b8b7e3a7650e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:34.337334 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54540a0-cab2-40cf-b2bb-b8b7e3a7650e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:34.337808 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54540a0-cab2-40cf-b2bb-b8b7e3a7650e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:34.350249 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54540a0-cab2-40cf-b2bb-b8b7e3a7650e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:34.352061 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54540a0-cab2-40cf-b2bb-b8b7e3a7650e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:34.372426 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-f54540a0-cab2-40cf-b2bb-b8b7e3a7650e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:34.372426 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:34.372426 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:34.372426 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:34.372426 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:34.372426 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:34.372426 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:34.372426 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:34.372426 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:34.372426 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:34.372426 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:34.372426 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:34.372426 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:05:34.372426 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:05:34.372426 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:05:34.373369 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:05:34.373369 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:34.373369 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:34.373369 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:34.373369 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:34.373369 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:34.373369 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:34.373369 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:34.373369 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:34.373369 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:34.373369 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:34.373369 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:34.373369 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:34.373369 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:34.373369 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:34.373369 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:34.373369 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:34.374204 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:05:34.374204 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:05:34.374204 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:34.374204 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:05:34.376292 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 238/473] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:05:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 04:05:34.382422 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83873c40-b76c-4f99-9ff1-0d1bc17896ad None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:34.460592 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:34.505679 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83873c40-b76c-4f99-9ff1-0d1bc17896ad None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:34.541590 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05757b8-d84c-43f5-a6b1-a565c1da8e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:34.542265 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05757b8-d84c-43f5-a6b1-a565c1da8e49 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:34.542550 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05757b8-d84c-43f5-a6b1-a565c1da8e49 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:34.542872 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05757b8-d84c-43f5-a6b1-a565c1da8e49 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:34.543609 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05757b8-d84c-43f5-a6b1-a565c1da8e49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:34.543957 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05757b8-d84c-43f5-a6b1-a565c1da8e49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:34.545483 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05757b8-d84c-43f5-a6b1-a565c1da8e49 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:34.554237 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2acbb2-4322-43c9-ad38-820019312d0a None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:34.554821 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2acbb2-4322-43c9-ad38-820019312d0a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:34.555288 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2acbb2-4322-43c9-ad38-820019312d0a None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:34.557219 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 239/474] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:05:34.560693 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 236/475] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:34.563934 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2acbb2-4322-43c9-ad38-820019312d0a None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:34.565307 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026656c0-30c4-4bb5-b716-8fc5a65bff04 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:34.565594 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026656c0-30c4-4bb5-b716-8fc5a65bff04 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:34.565870 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026656c0-30c4-4bb5-b716-8fc5a65bff04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:34.588526 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-026656c0-30c4-4bb5-b716-8fc5a65bff04 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:34.589802 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-026656c0-30c4-4bb5-b716-8fc5a65bff04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:34.594387 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:34.666908 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 237/476] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 18 04:05:34.679356 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2acbb2-4322-43c9-ad38-820019312d0a None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:34.691933 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026656c0-30c4-4bb5-b716-8fc5a65bff04 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:34.717484 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75631b-fd22-4886-b57f-518354b9c878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:34.718660 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75631b-fd22-4886-b57f-518354b9c878 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:34.719142 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75631b-fd22-4886-b57f-518354b9c878 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:34.719419 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75631b-fd22-4886-b57f-518354b9c878 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:34.720134 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e75631b-fd22-4886-b57f-518354b9c878 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:34.721617 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e75631b-fd22-4886-b57f-518354b9c878 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:34.756039 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 240/477] 10.222.0.20 () {60 vars in 1132 bytes} [Sat Jun 18 04:05:34 2022] POST /identity/v3/users => generated 249 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 04:05:34.756682 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:34.825470 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026656c0-30c4-4bb5-b716-8fc5a65bff04 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:34.880132 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c230d507-08da-4536-868b-cc5e965c3e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:34.880849 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230d507-08da-4536-868b-cc5e965c3e1a None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:34.881118 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230d507-08da-4536-868b-cc5e965c3e1a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:34.881397 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230d507-08da-4536-868b-cc5e965c3e1a None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:34.882155 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c230d507-08da-4536-868b-cc5e965c3e1a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:34.883559 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c230d507-08da-4536-868b-cc5e965c3e1a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:34.894429 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.sql.core [None req-c230d507-08da-4536-868b-cc5e965c3e1a None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 18 04:05:34.894429 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 18 04:05:34.894429 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [parameters: {'id': '5ce55e9181134b8da2ba24e48705a66a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 18 04:05:34.894429 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80240) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 18 04:05:34.919684 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-c230d507-08da-4536-868b-cc5e965c3e1a None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 18 04:05:34.919684 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:34.919684 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 18 04:05:34.919684 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 18 04:05:34.919684 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 18 04:05:34.919684 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 18 04:05:34.919684 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 18 04:05:34.919684 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application result = self._query(query) Jun 18 04:05:34.919684 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 18 04:05:34.919684 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application conn.query(q) Jun 18 04:05:34.919684 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 18 04:05:34.919684 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 18 04:05:34.919684 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 18 04:05:34.919684 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application result.read() Jun 18 04:05:34.919684 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 18 04:05:34.920625 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 18 04:05:34.920625 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 18 04:05:34.920625 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 18 04:05:34.920625 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 18 04:05:34.920625 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 18 04:05:34.920625 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 18 04:05:34.920625 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 18 04:05:34.920625 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 18 04:05:34.920625 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:34.920625 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 18 04:05:34.920625 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:34.920625 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:34.920625 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 18 04:05:34.920625 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 18 04:05:34.920625 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 18 04:05:34.920625 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return ref.to_dict() Jun 18 04:05:34.920625 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 18 04:05:34.920625 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application next(self.gen) Jun 18 04:05:34.921544 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 18 04:05:34.921544 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application yield resource Jun 18 04:05:34.921544 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 18 04:05:34.921544 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application next(self.gen) Jun 18 04:05:34.921544 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 18 04:05:34.921544 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self.session.rollback() Jun 18 04:05:34.921544 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 18 04:05:34.921544 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self.force_reraise() Jun 18 04:05:34.921544 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 18 04:05:34.921544 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise self.value Jun 18 04:05:34.921544 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 18 04:05:34.921544 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 18 04:05:34.921544 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 18 04:05:34.921544 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application session.commit() Jun 18 04:05:34.921544 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 18 04:05:34.921544 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 18 04:05:34.921544 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 18 04:05:34.922405 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._prepare_impl() Jun 18 04:05:34.922405 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 18 04:05:34.922405 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self.session.flush() Jun 18 04:05:34.922405 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 18 04:05:34.922405 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._flush(objects) Jun 18 04:05:34.922405 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 18 04:05:34.922405 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 18 04:05:34.922405 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 18 04:05:34.922405 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application compat.raise_( Jun 18 04:05:34.922405 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 18 04:05:34.922405 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception Jun 18 04:05:34.922405 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 18 04:05:34.922405 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application flush_context.execute() Jun 18 04:05:34.922405 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 18 04:05:34.922405 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rec.execute(self) Jun 18 04:05:34.922405 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 18 04:05:34.922405 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 18 04:05:34.923263 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 18 04:05:34.923263 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 18 04:05:34.923263 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 18 04:05:34.923263 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 18 04:05:34.923263 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 18 04:05:34.923263 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 18 04:05:34.923263 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 18 04:05:34.923263 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 18 04:05:34.923263 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 18 04:05:34.923263 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 18 04:05:34.923263 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 18 04:05:34.923263 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 18 04:05:34.923263 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 18 04:05:34.923263 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 18 04:05:34.923263 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 18 04:05:34.923263 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception Jun 18 04:05:34.925489 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 18 04:05:34.925489 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 18 04:05:34.925489 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 18 04:05:34.925489 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 18 04:05:34.925489 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 18 04:05:34.925489 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application result = self._query(query) Jun 18 04:05:34.925489 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 18 04:05:34.925489 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application conn.query(q) Jun 18 04:05:34.925489 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 18 04:05:34.925489 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 18 04:05:34.925489 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 18 04:05:34.925489 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application result.read() Jun 18 04:05:34.925489 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 18 04:05:34.925489 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 18 04:05:34.925489 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 18 04:05:34.925489 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 18 04:05:34.927443 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 18 04:05:34.927443 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 18 04:05:34.927443 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 18 04:05:34.927443 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 18 04:05:34.927443 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 18 04:05:34.927443 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 18 04:05:34.927443 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [parameters: {'id': '5ce55e9181134b8da2ba24e48705a66a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 18 04:05:34.927443 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 18 04:05:34.927443 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:34.927443 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 04:05:34.927443 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:34.927443 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:34.927443 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:34.927443 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:34.927443 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:34.927443 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:34.929417 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:34.929417 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:34.929417 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:34.929417 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:34.929417 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:34.929417 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:34.929417 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 18 04:05:34.929417 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 18 04:05:34.929417 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:34.929417 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:34.929417 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 18 04:05:34.929417 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 18 04:05:34.929417 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 18 04:05:34.929417 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 18 04:05:34.929417 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 18 04:05:34.929417 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:34.931341 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 238/478] 10.222.0.20 () {60 vars in 1131 bytes} [Sat Jun 18 04:05:34 2022] POST /identity/v3/roles => generated 144 bytes in 231 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 18 04:05:34.934752 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75631b-fd22-4886-b57f-518354b9c878 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:35.063885 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:35.088054 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75631b-fd22-4886-b57f-518354b9c878 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:35.125154 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf54e31-bb7d-4aff-a823-1849da45b865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:35.125971 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf54e31-bb7d-4aff-a823-1849da45b865 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:35.126245 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf54e31-bb7d-4aff-a823-1849da45b865 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:35.126512 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf54e31-bb7d-4aff-a823-1849da45b865 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:35.146923 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf54e31-bb7d-4aff-a823-1849da45b865 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:05:35.155233 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-aaf54e31-bb7d-4aff-a823-1849da45b865 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 18 04:05:35.155233 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:35.155233 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:35.155233 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:35.155233 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:35.155233 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:35.155233 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:35.155233 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:35.155233 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:35.155233 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:35.155233 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:35.155233 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:35.155233 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:05:35.155233 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:05:35.155233 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:05:35.155233 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:05:35.157230 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:05:35.157230 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:05:35.157230 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:05:35.157230 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:05:35.157230 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:35.157230 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:35.157230 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:35.157230 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:35.157230 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:35.157230 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:35.157230 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:35.157230 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:35.157230 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:35.157230 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:35.157230 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:35.157230 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:35.159164 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:35.159164 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:35.159164 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:35.159164 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:35.159164 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:05:35.159164 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:05:35.159164 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:05:35.159164 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:05:35.159164 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:05:35.159164 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:05:35.159164 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 18 04:05:35.159164 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:05:35.159164 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 241/479] 10.222.0.20 () {56 vars in 1114 bytes} [Sat Jun 18 04:05:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:35.165235 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c230d507-08da-4536-868b-cc5e965c3e1a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:35.272052 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c230d507-08da-4536-868b-cc5e965c3e1a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:35.290268 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:35.312746 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040090d6-b794-4579-a259-31b431182c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:35.313613 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040090d6-b794-4579-a259-31b431182c19 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:35.313892 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040090d6-b794-4579-a259-31b431182c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:35.314163 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040090d6-b794-4579-a259-31b431182c19 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:35.314952 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040090d6-b794-4579-a259-31b431182c19 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:35.317064 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040090d6-b794-4579-a259-31b431182c19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:35.318581 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040090d6-b794-4579-a259-31b431182c19 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:35.328360 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 239/480] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Jun 18 04:05:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:36.477267 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56767af-4383-4cab-ae74-785fbfe43e48 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:36.477267 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56767af-4383-4cab-ae74-785fbfe43e48 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:36.477267 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56767af-4383-4cab-ae74-785fbfe43e48 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:36.478563 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 242/481] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:05:36.488225 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d29adb-175d-46e3-a9fd-858362abdd8f None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:36.488225 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d29adb-175d-46e3-a9fd-858362abdd8f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:36.488225 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d29adb-175d-46e3-a9fd-858362abdd8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:36.504710 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-00d29adb-175d-46e3-a9fd-858362abdd8f None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:36.506214 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-00d29adb-175d-46e3-a9fd-858362abdd8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:36.574097 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 240/482] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:05:36.608444 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56767af-4383-4cab-ae74-785fbfe43e48 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:36.668637 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba58a7c-e2cc-410b-a7d1-9e814bb5c9e9 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:36.668951 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba58a7c-e2cc-410b-a7d1-9e814bb5c9e9 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:36.669200 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba58a7c-e2cc-410b-a7d1-9e814bb5c9e9 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:36.671418 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 241/483] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 18 04:05:36.676298 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308951d-2b3c-4c27-92d8-406a4f909d66 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:36.676623 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308951d-2b3c-4c27-92d8-406a4f909d66 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:36.676915 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308951d-2b3c-4c27-92d8-406a4f909d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:36.702921 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-c308951d-2b3c-4c27-92d8-406a4f909d66 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:36.704232 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c308951d-2b3c-4c27-92d8-406a4f909d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:36.749355 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56767af-4383-4cab-ae74-785fbfe43e48 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:36.818841 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80b1b9-b43a-48d8-b0ea-34bdbb578f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:36.819648 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80b1b9-b43a-48d8-b0ea-34bdbb578f13 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:36.819926 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80b1b9-b43a-48d8-b0ea-34bdbb578f13 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:36.820190 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80b1b9-b43a-48d8-b0ea-34bdbb578f13 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:36.837666 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 242/484] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:05:36.837953 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:36.842580 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a80b1b9-b43a-48d8-b0ea-34bdbb578f13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:05:36.851092 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-7a80b1b9-b43a-48d8-b0ea-34bdbb578f13 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 18 04:05:36.851092 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:36.851092 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:36.851092 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:36.851092 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:36.851092 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:36.851092 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:36.851092 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:36.851092 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:36.851092 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:36.851092 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:36.851092 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:36.851092 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:05:36.851092 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:05:36.851092 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:05:36.851092 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:05:36.851981 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:05:36.851981 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:05:36.851981 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:05:36.851981 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:05:36.851981 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:36.851981 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:36.851981 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:36.851981 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:36.851981 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:36.851981 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:36.851981 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:36.851981 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:36.851981 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:36.851981 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:36.851981 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:36.851981 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:36.852788 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:36.852788 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:36.852788 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:36.852788 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:36.852788 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:05:36.852788 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:05:36.852788 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:05:36.852788 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:05:36.852788 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:05:36.852788 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:05:36.852788 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 18 04:05:36.852788 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:05:36.852788 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 243/485] 10.222.0.20 () {56 vars in 1102 bytes} [Sat Jun 18 04:05:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:36.858287 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308951d-2b3c-4c27-92d8-406a4f909d66 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:36.883506 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80b1b9-b43a-48d8-b0ea-34bdbb578f13 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:36.938769 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:37.002856 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80b1b9-b43a-48d8-b0ea-34bdbb578f13 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:37.017369 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308951d-2b3c-4c27-92d8-406a4f909d66 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:37.052632 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd3a86-1052-4e50-a51b-66001eba4360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:37.053560 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd3a86-1052-4e50-a51b-66001eba4360 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:37.053866 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd3a86-1052-4e50-a51b-66001eba4360 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:37.054103 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd3a86-1052-4e50-a51b-66001eba4360 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:37.055851 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a31c6a1-df42-4f3b-a1d9-33fb595e27aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:37.056912 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31c6a1-df42-4f3b-a1d9-33fb595e27aa None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:37.057456 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31c6a1-df42-4f3b-a1d9-33fb595e27aa None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:37.057919 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31c6a1-df42-4f3b-a1d9-33fb595e27aa None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:37.058867 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a31c6a1-df42-4f3b-a1d9-33fb595e27aa None admin] RBAC: Adding query filter params (name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:37.059376 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a31c6a1-df42-4f3b-a1d9-33fb595e27aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:37.061212 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a31c6a1-df42-4f3b-a1d9-33fb595e27aa None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:37.065862 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dd3a86-1052-4e50-a51b-66001eba4360 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:05:37.070769 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 243/486] 10.222.0.20 () {56 vars in 1103 bytes} [Sat Jun 18 04:05:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:37.072378 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4d15c-8bc6-4611-aec3-6f4ba0c9d3a8 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:37.072885 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4d15c-8bc6-4611-aec3-6f4ba0c9d3a8 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:37.073372 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4d15c-8bc6-4611-aec3-6f4ba0c9d3a8 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:37.078965 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 244/487] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:05:37.079092 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-17dd3a86-1052-4e50-a51b-66001eba4360 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 18 04:05:37.079092 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:37.079092 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:37.079092 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:37.079092 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:37.079092 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:37.079092 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:37.079092 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:37.079092 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:37.079092 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:37.079092 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:37.079092 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:37.079092 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:05:37.079092 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:05:37.079092 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:05:37.079092 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:05:37.079915 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:05:37.079915 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:05:37.079915 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:05:37.079915 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:05:37.079915 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:37.079915 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:37.079915 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:37.079915 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:37.079915 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:37.079915 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:37.079915 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:37.079915 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:37.079915 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:37.079915 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:37.079915 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:37.079915 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:37.080728 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:37.080728 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:37.080728 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:37.080728 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:37.080728 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:05:37.080728 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:05:37.080728 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:05:37.080728 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:05:37.080728 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:05:37.080728 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:05:37.080728 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 18 04:05:37.080728 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:05:37.080728 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 244/488] 10.222.0.20 () {56 vars in 1102 bytes} [Sat Jun 18 04:05:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:37.081442 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd3a86-1052-4e50-a51b-66001eba4360 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:37.083494 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d629a-c4b2-4a43-bb0b-983774ff2c1a None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:37.083986 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d629a-c4b2-4a43-bb0b-983774ff2c1a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:37.084448 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d629a-c4b2-4a43-bb0b-983774ff2c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:37.102675 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-740d629a-c4b2-4a43-bb0b-983774ff2c1a None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:37.104509 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-740d629a-c4b2-4a43-bb0b-983774ff2c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:37.154327 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:37.204596 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 245/489] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:05:37.204596 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d629a-c4b2-4a43-bb0b-983774ff2c1a None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:37.227916 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd3a86-1052-4e50-a51b-66001eba4360 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:37.245168 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:37.266758 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718101bc-e572-4b42-8c4e-d6434bd36934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:37.267637 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718101bc-e572-4b42-8c4e-d6434bd36934 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:37.267926 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718101bc-e572-4b42-8c4e-d6434bd36934 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:37.268200 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718101bc-e572-4b42-8c4e-d6434bd36934 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:37.282525 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718101bc-e572-4b42-8c4e-d6434bd36934 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:37.284019 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718101bc-e572-4b42-8c4e-d6434bd36934 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:37.306239 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-718101bc-e572-4b42-8c4e-d6434bd36934 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:37.306239 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:37.306239 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:37.306239 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:37.306239 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:37.306239 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:37.306239 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:37.306239 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:37.306239 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:37.306239 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:37.306239 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:37.306239 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:37.306239 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:05:37.306239 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:05:37.306239 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:05:37.307224 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:05:37.307224 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:37.307224 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:37.307224 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:37.307224 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:37.307224 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:37.307224 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:37.307224 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:37.307224 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:37.307224 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:37.307224 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:37.307224 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:37.307224 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:37.307224 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:37.307224 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:37.307224 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:37.307224 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:37.308045 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:05:37.308045 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:05:37.308045 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:37.308045 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:05:37.308045 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 245/490] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:05:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:37.308305 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718101bc-e572-4b42-8c4e-d6434bd36934 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:37.323062 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d629a-c4b2-4a43-bb0b-983774ff2c1a None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:37.358097 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ffdbb-7df3-44d9-b58c-b6a91e7986e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:37.359110 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ffdbb-7df3-44d9-b58c-b6a91e7986e1 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:37.359937 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ffdbb-7df3-44d9-b58c-b6a91e7986e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:37.360462 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ffdbb-7df3-44d9-b58c-b6a91e7986e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:37.361500 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ffdbb-7df3-44d9-b58c-b6a91e7986e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:37.361986 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ffdbb-7df3-44d9-b58c-b6a91e7986e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:37.363566 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ffdbb-7df3-44d9-b58c-b6a91e7986e1 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:37.372935 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 246/491] 10.222.0.20 () {56 vars in 1103 bytes} [Sat Jun 18 04:05:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:37.374046 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ffdbb-7df3-44d9-b58c-b6a91e7986e1 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:37.438250 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718101bc-e572-4b42-8c4e-d6434bd36934 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:37.449459 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:37.472118 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:37.476301 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6bb1c-a642-43ae-a0fd-923fdfffaac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:37.476966 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6bb1c-a642-43ae-a0fd-923fdfffaac0 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:37.477254 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6bb1c-a642-43ae-a0fd-923fdfffaac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:37.477520 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6bb1c-a642-43ae-a0fd-923fdfffaac0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:37.480206 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ffdbb-7df3-44d9-b58c-b6a91e7986e1 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:37.488480 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca6bb1c-a642-43ae-a0fd-923fdfffaac0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:05:37.496321 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-2ca6bb1c-a642-43ae-a0fd-923fdfffaac0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 18 04:05:37.496321 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:37.496321 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:37.496321 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:37.496321 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:37.496321 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:37.496321 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:37.496321 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:37.496321 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:37.496321 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:37.496321 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:37.496321 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:37.496321 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:05:37.496321 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:05:37.496321 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:05:37.496321 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:05:37.497359 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:05:37.497359 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:05:37.497359 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:05:37.497359 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:05:37.497359 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:37.497359 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:37.497359 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:37.497359 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:37.497359 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:37.497359 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:37.497359 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:37.497359 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:37.497359 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:37.497359 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:37.497359 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:37.497359 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:37.498145 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:37.498145 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:37.498145 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:37.498145 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:37.498145 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:05:37.498145 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:05:37.498145 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:05:37.498145 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:05:37.498145 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:05:37.498145 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:05:37.498145 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 18 04:05:37.498145 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:05:37.498145 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 246/492] 10.222.0.20 () {56 vars in 1102 bytes} [Sat Jun 18 04:05:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:37.499447 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6bb1c-a642-43ae-a0fd-923fdfffaac0 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:37.521390 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111ea500-e501-4f5c-a6d2-050adf8c89fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:37.522106 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ea500-e501-4f5c-a6d2-050adf8c89fb None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:37.522371 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ea500-e501-4f5c-a6d2-050adf8c89fb None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:37.522564 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ea500-e501-4f5c-a6d2-050adf8c89fb None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:37.523297 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111ea500-e501-4f5c-a6d2-050adf8c89fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:37.523596 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111ea500-e501-4f5c-a6d2-050adf8c89fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:37.525010 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111ea500-e501-4f5c-a6d2-050adf8c89fb None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:37.542383 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 247/493] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:05:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:37.542383 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b50bf-2d53-45e1-830a-96457a752ebe None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:37.542383 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b50bf-2d53-45e1-830a-96457a752ebe None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:37.542383 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b50bf-2d53-45e1-830a-96457a752ebe None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:37.542383 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 248/494] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:05:37.542383 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b50bf-2d53-45e1-830a-96457a752ebe None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:37.609057 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6bb1c-a642-43ae-a0fd-923fdfffaac0 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:37.645649 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a3cc59-35f7-491e-b466-f78b0a3f99f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:37.646591 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3cc59-35f7-491e-b466-f78b0a3f99f3 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:37.646874 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3cc59-35f7-491e-b466-f78b0a3f99f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:37.647123 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3cc59-35f7-491e-b466-f78b0a3f99f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:37.648781 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b50bf-2d53-45e1-830a-96457a752ebe None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:37.658846 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a3cc59-35f7-491e-b466-f78b0a3f99f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:37.660306 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a3cc59-35f7-491e-b466-f78b0a3f99f3 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:37.678637 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-c6a3cc59-35f7-491e-b466-f78b0a3f99f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:37.678637 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:37.678637 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:37.678637 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:37.678637 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:37.678637 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:37.678637 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:37.678637 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:37.678637 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:37.678637 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:37.678637 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:37.678637 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:37.678637 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:05:37.678637 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:05:37.678637 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:05:37.679538 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:05:37.679538 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:37.679538 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:37.679538 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:37.679538 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:37.679538 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:37.679538 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:37.679538 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:37.679538 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:37.679538 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:37.679538 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:37.679538 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:37.679538 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:37.679538 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:37.679538 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:37.679538 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:37.679538 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:37.680357 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:05:37.680357 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:05:37.680357 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:37.680357 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:05:37.680357 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 247/495] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:05:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:37.680658 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a3cc59-35f7-491e-b466-f78b0a3f99f3 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:37.690924 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2946545e-bfc4-4192-acac-ccbf4baaae75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:37.691822 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946545e-bfc4-4192-acac-ccbf4baaae75 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:37.692264 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946545e-bfc4-4192-acac-ccbf4baaae75 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:37.693135 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946545e-bfc4-4192-acac-ccbf4baaae75 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:37.694052 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2946545e-bfc4-4192-acac-ccbf4baaae75 None admin] RBAC: Adding query filter params (name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:37.694518 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2946545e-bfc4-4192-acac-ccbf4baaae75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:37.696685 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2946545e-bfc4-4192-acac-ccbf4baaae75 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:37.705194 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 249/496] 10.222.0.20 () {56 vars in 1103 bytes} [Sat Jun 18 04:05:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:37.706560 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425245cf-a002-4d7e-8ca5-fb702aae1eb6 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:37.706843 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425245cf-a002-4d7e-8ca5-fb702aae1eb6 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:37.707111 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425245cf-a002-4d7e-8ca5-fb702aae1eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:37.713258 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:37.724466 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-425245cf-a002-4d7e-8ca5-fb702aae1eb6 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:37.725842 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-425245cf-a002-4d7e-8ca5-fb702aae1eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:37.737532 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:37.796671 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a3cc59-35f7-491e-b466-f78b0a3f99f3 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:37.812599 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 250/497] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:05:37.812599 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425245cf-a002-4d7e-8ca5-fb702aae1eb6 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:37.844671 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3d6b3-5a91-4976-aa62-1359beeb4acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:37.845450 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3d6b3-5a91-4976-aa62-1359beeb4acd None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:37.845723 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3d6b3-5a91-4976-aa62-1359beeb4acd None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:37.845989 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3d6b3-5a91-4976-aa62-1359beeb4acd None admin] PATH_INFO: `/v3/users/glance` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:37.853793 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f3d6b3-5a91-4976-aa62-1359beeb4acd None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:37.855248 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f3d6b3-5a91-4976-aa62-1359beeb4acd None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:37.870959 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-b1f3d6b3-5a91-4976-aa62-1359beeb4acd None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 18 04:05:37.870959 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:37.870959 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:37.870959 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:37.870959 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:37.870959 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:37.870959 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:37.870959 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:37.870959 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:37.870959 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:37.870959 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:37.870959 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:37.870959 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 04:05:37.870959 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 04:05:37.870959 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 04:05:37.870959 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 04:05:37.871870 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:37.871870 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:37.871870 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 04:05:37.871870 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 04:05:37.871870 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 04:05:37.871870 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 04:05:37.871870 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:37.871870 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:37.871870 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:37.871870 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:37.871870 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:37.871870 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:37.871870 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:37.871870 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:37.871870 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:37.871870 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:37.871870 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:37.871870 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:37.872769 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:37.872769 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:37.872769 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 04:05:37.872769 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 04:05:37.872769 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 04:05:37.872769 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 04:05:37.872769 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 04:05:37.872769 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 04:05:37.872769 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 18 04:05:37.872769 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:05:37.872769 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 248/498] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Jun 18 04:05:37 2022] GET /identity/v3/users/glance => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:37.873324 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3d6b3-5a91-4976-aa62-1359beeb4acd None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:37.925705 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425245cf-a002-4d7e-8ca5-fb702aae1eb6 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:37.962460 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:37.964334 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc9d875-4ac5-4db2-b087-1a763a1d231b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:37.965233 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9d875-4ac5-4db2-b087-1a763a1d231b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:37.965667 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9d875-4ac5-4db2-b087-1a763a1d231b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:37.965948 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9d875-4ac5-4db2-b087-1a763a1d231b None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:37.966974 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc9d875-4ac5-4db2-b087-1a763a1d231b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:37.967286 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc9d875-4ac5-4db2-b087-1a763a1d231b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:37.968722 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc9d875-4ac5-4db2-b087-1a763a1d231b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:37.981075 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 251/499] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:05:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:37.981636 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3d6b3-5a91-4976-aa62-1359beeb4acd None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:37.981954 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc9d875-4ac5-4db2-b087-1a763a1d231b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:37.995586 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:38.018255 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2168efcd-dd6f-4dea-9687-086610a96d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:38.019055 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168efcd-dd6f-4dea-9687-086610a96d9c None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:38.019333 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168efcd-dd6f-4dea-9687-086610a96d9c None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:38.019602 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168efcd-dd6f-4dea-9687-086610a96d9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:38.030896 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2168efcd-dd6f-4dea-9687-086610a96d9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:38.032370 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2168efcd-dd6f-4dea-9687-086610a96d9c None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:38.049188 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-2168efcd-dd6f-4dea-9687-086610a96d9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:38.049188 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:38.049188 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:38.049188 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:38.049188 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:38.049188 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:38.049188 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:38.049188 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:38.049188 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:38.049188 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:38.049188 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:38.049188 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:38.049188 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:05:38.049188 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:05:38.049188 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:05:38.050183 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:05:38.050183 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:38.050183 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:38.050183 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:38.050183 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:38.050183 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:38.050183 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:38.050183 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:38.050183 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:38.050183 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:38.050183 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:38.050183 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:38.050183 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:38.050183 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:38.050183 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:38.050183 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:38.050183 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:38.051017 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:05:38.051017 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:05:38.051017 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:38.051017 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:05:38.051675 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 249/500] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:05:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:38.052492 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2168efcd-dd6f-4dea-9687-086610a96d9c None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:38.084590 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc9d875-4ac5-4db2-b087-1a763a1d231b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:38.117458 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0966c435-bbde-45ab-9ef3-d4da91f472e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:38.118258 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966c435-bbde-45ab-9ef3-d4da91f472e2 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:38.118536 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966c435-bbde-45ab-9ef3-d4da91f472e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:38.118806 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966c435-bbde-45ab-9ef3-d4da91f472e2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:38.128975 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0966c435-bbde-45ab-9ef3-d4da91f472e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:05:38.136689 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-0966c435-bbde-45ab-9ef3-d4da91f472e2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 18 04:05:38.136689 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:38.136689 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:38.136689 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:38.136689 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:38.136689 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:38.136689 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:38.136689 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:38.136689 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:38.136689 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:38.136689 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:38.136689 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:38.136689 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:05:38.136689 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:05:38.136689 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:05:38.136689 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:05:38.137553 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:05:38.137553 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:05:38.137553 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:05:38.137553 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:05:38.137553 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:38.137553 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:38.137553 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:38.137553 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:38.137553 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:38.137553 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:38.137553 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:38.137553 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:38.137553 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:38.137553 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:38.137553 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:38.137553 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:38.138355 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:38.138355 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:38.138355 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:38.138355 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:38.138355 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:05:38.138355 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:05:38.138355 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:05:38.138355 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:05:38.138355 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:05:38.138355 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:05:38.138355 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 18 04:05:38.138355 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:38.138355 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 252/501] 10.222.0.20 () {56 vars in 1102 bytes} [Sat Jun 18 04:05:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:38.139477 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db30eaf-59bb-4aff-9ed4-968639a4c7c0 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:38.139477 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db30eaf-59bb-4aff-9ed4-968639a4c7c0 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:38.139698 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db30eaf-59bb-4aff-9ed4-968639a4c7c0 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:38.141070 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 253/502] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:05:38.141648 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db30eaf-59bb-4aff-9ed4-968639a4c7c0 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:38.156744 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2168efcd-dd6f-4dea-9687-086610a96d9c None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:38.191477 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d8cee-1b15-4ab8-986a-2f8b73347950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:38.192174 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d8cee-1b15-4ab8-986a-2f8b73347950 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:38.192455 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d8cee-1b15-4ab8-986a-2f8b73347950 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:38.192748 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d8cee-1b15-4ab8-986a-2f8b73347950 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:38.193597 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d8cee-1b15-4ab8-986a-2f8b73347950 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:38.193898 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d8cee-1b15-4ab8-986a-2f8b73347950 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:38.195322 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d8cee-1b15-4ab8-986a-2f8b73347950 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:38.197262 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:38.207007 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:38.231833 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 250/503] 10.222.0.20 () {56 vars in 1137 bytes} [Sat Jun 18 04:05:38 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:38.232687 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d8cee-1b15-4ab8-986a-2f8b73347950 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:38.248693 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db30eaf-59bb-4aff-9ed4-968639a4c7c0 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:38.285150 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd822ca-3b08-4bdc-9292-44e96a2f1766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:38.285952 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd822ca-3b08-4bdc-9292-44e96a2f1766 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:38.286228 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd822ca-3b08-4bdc-9292-44e96a2f1766 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:38.286497 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd822ca-3b08-4bdc-9292-44e96a2f1766 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:38.294248 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd822ca-3b08-4bdc-9292-44e96a2f1766 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:38.295718 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd822ca-3b08-4bdc-9292-44e96a2f1766 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:38.311519 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-8bd822ca-3b08-4bdc-9292-44e96a2f1766 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 18 04:05:38.311519 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:38.311519 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:38.311519 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:38.311519 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:38.311519 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:38.311519 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:38.311519 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:38.311519 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:38.311519 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:38.311519 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:38.311519 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:38.311519 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 04:05:38.311519 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 04:05:38.311519 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 04:05:38.311519 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 04:05:38.312407 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:38.312407 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:38.312407 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 04:05:38.312407 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 04:05:38.312407 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 04:05:38.312407 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 04:05:38.312407 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:38.312407 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:38.312407 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:38.312407 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:38.312407 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:38.312407 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:38.312407 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:38.312407 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:38.312407 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:38.312407 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:38.312407 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:38.312407 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:38.318110 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:38.318110 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:38.318110 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 04:05:38.318110 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 04:05:38.318110 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 04:05:38.318110 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 04:05:38.318110 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 04:05:38.318110 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 04:05:38.318110 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 18 04:05:38.318110 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:38.318110 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 254/504] 10.222.0.20 () {56 vars in 1093 bytes} [Sat Jun 18 04:05:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:38.318110 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd822ca-3b08-4bdc-9292-44e96a2f1766 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:38.332518 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d8cee-1b15-4ab8-986a-2f8b73347950 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:38.367098 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94162b9-ff15-4834-8cad-50c6a764d821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:38.367747 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94162b9-ff15-4834-8cad-50c6a764d821 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:38.368028 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94162b9-ff15-4834-8cad-50c6a764d821 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:38.368298 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94162b9-ff15-4834-8cad-50c6a764d821 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:38.369110 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94162b9-ff15-4834-8cad-50c6a764d821 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:38.369419 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94162b9-ff15-4834-8cad-50c6a764d821 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:38.370807 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94162b9-ff15-4834-8cad-50c6a764d821 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:38.382004 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 251/505] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:05:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:38.382990 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4d116-ed31-43e2-ba72-4c4429607c0d None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:38.383275 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4d116-ed31-43e2-ba72-4c4429607c0d None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:38.383552 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4d116-ed31-43e2-ba72-4c4429607c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:38.399479 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-bae4d116-ed31-43e2-ba72-4c4429607c0d None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:38.400797 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-bae4d116-ed31-43e2-ba72-4c4429607c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:38.420115 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd822ca-3b08-4bdc-9292-44e96a2f1766 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:38.444565 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:38.446532 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:38.454438 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b6d9d-98ad-451e-aeea-219e8eec2ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:38.455129 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b6d9d-98ad-451e-aeea-219e8eec2ce9 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:38.455399 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b6d9d-98ad-451e-aeea-219e8eec2ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:38.455667 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b6d9d-98ad-451e-aeea-219e8eec2ce9 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:38.456403 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b6d9d-98ad-451e-aeea-219e8eec2ce9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:38.456735 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b6d9d-98ad-451e-aeea-219e8eec2ce9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:38.458120 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b6d9d-98ad-451e-aeea-219e8eec2ce9 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:38.465695 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 252/506] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:05:38.466511 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae4d116-ed31-43e2-ba72-4c4429607c0d None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:38.466891 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 255/507] 10.222.0.20 () {56 vars in 1103 bytes} [Sat Jun 18 04:05:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:38.467770 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b6d9d-98ad-451e-aeea-219e8eec2ce9 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:38.566881 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b6d9d-98ad-451e-aeea-219e8eec2ce9 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:38.575410 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae4d116-ed31-43e2-ba72-4c4429607c0d None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:38.600101 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe1ac1-0802-448e-a454-b251db1bafda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:38.600778 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe1ac1-0802-448e-a454-b251db1bafda None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:38.601057 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe1ac1-0802-448e-a454-b251db1bafda None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:38.601327 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe1ac1-0802-448e-a454-b251db1bafda None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:38.602155 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe1ac1-0802-448e-a454-b251db1bafda None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:38.602457 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe1ac1-0802-448e-a454-b251db1bafda None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:38.603941 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe1ac1-0802-448e-a454-b251db1bafda None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:38.609116 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9808b17a-1e11-4934-b2d7-d3eeaa726b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:38.610120 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808b17a-1e11-4934-b2d7-d3eeaa726b5c None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:38.610393 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808b17a-1e11-4934-b2d7-d3eeaa726b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:38.610662 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808b17a-1e11-4934-b2d7-d3eeaa726b5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:38.639591 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 256/508] 10.222.0.20 () {56 vars in 1133 bytes} [Sat Jun 18 04:05:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:38.640397 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe1ac1-0802-448e-a454-b251db1bafda None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:38.664439 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:38.686317 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9808b17a-1e11-4934-b2d7-d3eeaa726b5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:38.687617 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:38.687789 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9808b17a-1e11-4934-b2d7-d3eeaa726b5c None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:38.739468 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe1ac1-0802-448e-a454-b251db1bafda None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:38.775425 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875cb669-bf5d-4c76-8078-5ca48523fca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:38.776226 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875cb669-bf5d-4c76-8078-5ca48523fca7 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:38.776503 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875cb669-bf5d-4c76-8078-5ca48523fca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:38.776802 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875cb669-bf5d-4c76-8078-5ca48523fca7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:38.783884 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875cb669-bf5d-4c76-8078-5ca48523fca7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:38.785365 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875cb669-bf5d-4c76-8078-5ca48523fca7 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:38.787079 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 253/509] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Jun 18 04:05:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 04:05:38.787958 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9808b17a-1e11-4934-b2d7-d3eeaa726b5c None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:38.799852 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-875cb669-bf5d-4c76-8078-5ca48523fca7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 18 04:05:38.799852 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:38.799852 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:38.799852 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:38.799852 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:38.799852 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:38.799852 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:38.799852 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:38.799852 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:38.799852 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:38.799852 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:38.799852 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:38.799852 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 04:05:38.799852 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 04:05:38.799852 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 04:05:38.799852 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 04:05:38.800800 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:38.800800 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:38.800800 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 04:05:38.800800 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 04:05:38.800800 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 04:05:38.800800 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 04:05:38.800800 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:38.800800 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:38.800800 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:38.800800 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:38.800800 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:38.800800 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:38.800800 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:38.800800 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:38.800800 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:38.800800 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:38.800800 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:38.800800 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:38.801674 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:38.801674 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:38.801674 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 04:05:38.801674 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 04:05:38.801674 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 04:05:38.801674 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 04:05:38.801674 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 04:05:38.801674 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 04:05:38.801674 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 18 04:05:38.801674 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:38.801674 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 257/510] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Jun 18 04:05:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:38.802229 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875cb669-bf5d-4c76-8078-5ca48523fca7 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:38.870641 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:38.888895 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9808b17a-1e11-4934-b2d7-d3eeaa726b5c None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:38.902850 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875cb669-bf5d-4c76-8078-5ca48523fca7 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:38.909868 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:38.922817 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195686d3-3843-4a9e-8c8d-c38bac04e56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:38.923608 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195686d3-3843-4a9e-8c8d-c38bac04e56a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:38.923887 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195686d3-3843-4a9e-8c8d-c38bac04e56a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:38.924158 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195686d3-3843-4a9e-8c8d-c38bac04e56a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:38.934098 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195686d3-3843-4a9e-8c8d-c38bac04e56a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:38.935545 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195686d3-3843-4a9e-8c8d-c38bac04e56a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:38.937566 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58fd8cb-3d34-4bb3-a3c8-754e2475d35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:38.938345 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fd8cb-3d34-4bb3-a3c8-754e2475d35d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:38.938618 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fd8cb-3d34-4bb3-a3c8-754e2475d35d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:38.938884 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fd8cb-3d34-4bb3-a3c8-754e2475d35d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:38.948794 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58fd8cb-3d34-4bb3-a3c8-754e2475d35d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:38.950241 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58fd8cb-3d34-4bb3-a3c8-754e2475d35d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:38.952376 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-195686d3-3843-4a9e-8c8d-c38bac04e56a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:38.952376 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:38.952376 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:38.952376 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:38.952376 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:38.952376 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:38.952376 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:38.952376 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:38.952376 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:38.952376 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:38.952376 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:38.952376 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:38.952376 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:05:38.952376 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:05:38.952376 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:05:38.953303 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:05:38.953303 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:38.953303 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:38.953303 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:38.953303 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:38.953303 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:38.953303 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:38.953303 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:38.953303 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:38.953303 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:38.953303 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:38.953303 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:38.953303 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:38.953303 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:38.953303 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:38.953303 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:38.953303 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:38.954151 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:05:38.954151 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:05:38.954151 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:38.954151 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:05:38.954151 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 254/511] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:05:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:38.954412 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195686d3-3843-4a9e-8c8d-c38bac04e56a None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:38.969699 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-b58fd8cb-3d34-4bb3-a3c8-754e2475d35d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:38.969699 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:38.969699 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:38.969699 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:38.969699 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:38.969699 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:38.969699 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:38.969699 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:38.969699 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:38.969699 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:38.969699 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:38.969699 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:38.969699 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:05:38.969699 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:05:38.969699 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:05:38.970614 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:05:38.970614 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:38.970614 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:38.970614 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:38.970614 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:38.970614 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:38.970614 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:38.970614 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:38.970614 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:38.970614 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:38.970614 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:38.970614 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:38.970614 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:38.970614 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:38.970614 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:38.970614 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:38.970614 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:38.971474 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:05:38.971474 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:05:38.971474 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:38.971474 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:38.971474 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 258/512] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:05:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:38.971740 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58fd8cb-3d34-4bb3-a3c8-754e2475d35d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:39.059552 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195686d3-3843-4a9e-8c8d-c38bac04e56a None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:39.072267 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58fd8cb-3d34-4bb3-a3c8-754e2475d35d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:39.092671 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da67cd5-5c66-4959-99b4-c49fe7ce1a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:39.093310 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da67cd5-5c66-4959-99b4-c49fe7ce1a71 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:39.093589 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da67cd5-5c66-4959-99b4-c49fe7ce1a71 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:39.093862 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da67cd5-5c66-4959-99b4-c49fe7ce1a71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:39.096459 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:39.105098 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e960e-a290-4780-91f2-4f4b5e4c8435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:39.105890 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e960e-a290-4780-91f2-4f4b5e4c8435 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:39.106164 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e960e-a290-4780-91f2-4f4b5e4c8435 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:39.106435 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e960e-a290-4780-91f2-4f4b5e4c8435 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:39.116636 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e960e-a290-4780-91f2-4f4b5e4c8435 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:39.118104 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e960e-a290-4780-91f2-4f4b5e4c8435 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:39.135437 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-cf1e960e-a290-4780-91f2-4f4b5e4c8435 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:39.135437 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:39.135437 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:39.135437 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:39.135437 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:39.135437 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:39.135437 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:39.135437 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:39.135437 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:39.135437 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:39.135437 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:39.135437 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:39.135437 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:05:39.135437 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:05:39.135437 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:05:39.136320 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:05:39.136320 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:39.136320 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:39.136320 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:39.136320 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:39.136320 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:39.136320 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:39.136320 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:39.136320 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:39.136320 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:39.136320 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:39.136320 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:39.136320 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:39.136320 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:39.136320 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:39.136320 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:39.136320 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:39.137462 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:05:39.137462 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:05:39.137462 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:39.137462 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:39.137462 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 259/513] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:05:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:39.137462 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e960e-a290-4780-91f2-4f4b5e4c8435 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:39.149114 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:39.166717 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da67cd5-5c66-4959-99b4-c49fe7ce1a71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:39.168205 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da67cd5-5c66-4959-99b4-c49fe7ce1a71 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:39.237776 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e960e-a290-4780-91f2-4f4b5e4c8435 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:39.264346 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 255/514] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Jun 18 04:05:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 04:05:39.265506 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da67cd5-5c66-4959-99b4-c49fe7ce1a71 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:39.275113 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99db117-1060-42e9-8b07-e866808b20bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:39.275890 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99db117-1060-42e9-8b07-e866808b20bc None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:39.276234 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99db117-1060-42e9-8b07-e866808b20bc None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:39.276538 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99db117-1060-42e9-8b07-e866808b20bc None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:39.277440 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99db117-1060-42e9-8b07-e866808b20bc None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:39.277749 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99db117-1060-42e9-8b07-e866808b20bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:39.279198 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99db117-1060-42e9-8b07-e866808b20bc None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:39.297084 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 260/515] 10.222.0.20 () {56 vars in 1137 bytes} [Sat Jun 18 04:05:39 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:39.297877 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99db117-1060-42e9-8b07-e866808b20bc None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:39.305346 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:39.365325 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:39.372514 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da67cd5-5c66-4959-99b4-c49fe7ce1a71 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:39.401271 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99db117-1060-42e9-8b07-e866808b20bc None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:39.408037 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e06ab-5862-4484-9846-8fadd46d7051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:39.408738 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e06ab-5862-4484-9846-8fadd46d7051 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:39.409021 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e06ab-5862-4484-9846-8fadd46d7051 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:39.409292 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e06ab-5862-4484-9846-8fadd46d7051 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:39.410018 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e06ab-5862-4484-9846-8fadd46d7051 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:39.410324 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e06ab-5862-4484-9846-8fadd46d7051 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:39.411721 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e06ab-5862-4484-9846-8fadd46d7051 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:39.423006 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 256/516] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:05:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:39.423787 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e06ab-5862-4484-9846-8fadd46d7051 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:39.437136 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1ffb09-56f7-4ac7-9ecb-502d4171fb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:39.437801 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ffb09-56f7-4ac7-9ecb-502d4171fb6a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:39.438065 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ffb09-56f7-4ac7-9ecb-502d4171fb6a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:39.438355 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ffb09-56f7-4ac7-9ecb-502d4171fb6a None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:39.439072 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1ffb09-56f7-4ac7-9ecb-502d4171fb6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:39.439360 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1ffb09-56f7-4ac7-9ecb-502d4171fb6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:39.440788 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1ffb09-56f7-4ac7-9ecb-502d4171fb6a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:39.451749 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 261/517] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:05:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:39.452542 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1ffb09-56f7-4ac7-9ecb-502d4171fb6a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:39.527869 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:39.535976 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e06ab-5862-4484-9846-8fadd46d7051 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:39.553222 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1ffb09-56f7-4ac7-9ecb-502d4171fb6a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:39.574437 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe06a56-72de-4398-80a5-42c23a290201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:39.575084 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe06a56-72de-4398-80a5-42c23a290201 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:39.575359 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe06a56-72de-4398-80a5-42c23a290201 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:39.575628 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe06a56-72de-4398-80a5-42c23a290201 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:39.576822 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe06a56-72de-4398-80a5-42c23a290201 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:39.577285 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe06a56-72de-4398-80a5-42c23a290201 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:39.578707 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe06a56-72de-4398-80a5-42c23a290201 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:39.580271 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:39.589376 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155dcce2-c86b-482a-b2f3-529cb5b7d172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:39.590165 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155dcce2-c86b-482a-b2f3-529cb5b7d172 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:39.590440 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155dcce2-c86b-482a-b2f3-529cb5b7d172 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:39.590706 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155dcce2-c86b-482a-b2f3-529cb5b7d172 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:39.595683 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 257/518] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:05:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:39.595683 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe06a56-72de-4398-80a5-42c23a290201 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:39.604841 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155dcce2-c86b-482a-b2f3-529cb5b7d172 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:39.606307 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155dcce2-c86b-482a-b2f3-529cb5b7d172 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:39.623912 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-155dcce2-c86b-482a-b2f3-529cb5b7d172 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:39.623912 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:39.623912 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:39.623912 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:39.623912 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:39.623912 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:39.623912 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:39.623912 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:39.623912 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:39.623912 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:39.623912 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:39.623912 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:39.623912 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:05:39.623912 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:05:39.623912 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:05:39.624836 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:05:39.624836 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:39.624836 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:39.624836 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:39.624836 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:39.624836 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:39.624836 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:39.624836 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:39.624836 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:39.624836 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:39.624836 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:39.624836 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:39.624836 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:39.624836 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:39.624836 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:39.624836 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:39.624836 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:39.625654 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:05:39.625654 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:05:39.625654 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:39.625654 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:39.625654 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 262/519] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:05:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:39.626249 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155dcce2-c86b-482a-b2f3-529cb5b7d172 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:39.692224 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe06a56-72de-4398-80a5-42c23a290201 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:39.726003 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20e6ff-b616-48d8-99be-b2cfd6202f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:39.726640 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20e6ff-b616-48d8-99be-b2cfd6202f42 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:39.726912 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20e6ff-b616-48d8-99be-b2cfd6202f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:39.727177 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20e6ff-b616-48d8-99be-b2cfd6202f42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:39.731042 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155dcce2-c86b-482a-b2f3-529cb5b7d172 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:39.751376 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:39.767949 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ccfddc-246a-409f-ad61-1f88a3e3342b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:39.768790 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ccfddc-246a-409f-ad61-1f88a3e3342b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:39.769075 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ccfddc-246a-409f-ad61-1f88a3e3342b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:39.769350 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ccfddc-246a-409f-ad61-1f88a3e3342b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:39.777800 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ccfddc-246a-409f-ad61-1f88a3e3342b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:39.779261 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ccfddc-246a-409f-ad61-1f88a3e3342b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:39.793961 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-36ccfddc-246a-409f-ad61-1f88a3e3342b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 18 04:05:39.793961 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:39.793961 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:39.793961 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:39.793961 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:39.793961 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:39.793961 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:39.793961 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:39.793961 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:39.793961 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:39.793961 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:39.793961 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:39.793961 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 04:05:39.793961 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 04:05:39.793961 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 04:05:39.793961 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 04:05:39.795363 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:39.795363 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:39.795363 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 04:05:39.795363 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 04:05:39.795363 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 04:05:39.795363 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 04:05:39.795363 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:39.795363 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:39.795363 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:39.795363 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:39.795363 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:39.795363 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:39.795363 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:39.795363 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:39.795363 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:39.795363 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:39.795363 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:39.795363 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:39.796908 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:39.796908 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:39.796908 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 04:05:39.796908 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 04:05:39.796908 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 04:05:39.796908 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 04:05:39.796908 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 04:05:39.796908 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 04:05:39.796908 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 18 04:05:39.796908 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:39.796908 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 263/520] 10.222.0.20 () {56 vars in 1102 bytes} [Sat Jun 18 04:05:39 2022] GET /identity/v3/users/neutron => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:39.796908 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ccfddc-246a-409f-ad61-1f88a3e3342b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:39.801065 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f20e6ff-b616-48d8-99be-b2cfd6202f42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:39.802575 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f20e6ff-b616-48d8-99be-b2cfd6202f42 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:39.836768 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:39.898424 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ccfddc-246a-409f-ad61-1f88a3e3342b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:39.908086 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 258/521] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Jun 18 04:05:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 04:05:39.909056 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20e6ff-b616-48d8-99be-b2cfd6202f42 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:39.935435 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f0314f-5fa7-4c58-9fe3-c0e432ba2315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:39.936302 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0314f-5fa7-4c58-9fe3-c0e432ba2315 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:39.936681 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0314f-5fa7-4c58-9fe3-c0e432ba2315 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:39.937010 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0314f-5fa7-4c58-9fe3-c0e432ba2315 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:39.937725 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f0314f-5fa7-4c58-9fe3-c0e432ba2315 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:39.939184 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f0314f-5fa7-4c58-9fe3-c0e432ba2315 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:39.967300 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:39.972808 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 264/522] 10.222.0.20 () {60 vars in 1132 bytes} [Sat Jun 18 04:05:39 2022] POST /identity/v3/users => generated 247 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 04:05:39.974391 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f0314f-5fa7-4c58-9fe3-c0e432ba2315 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:40.031163 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20e6ff-b616-48d8-99be-b2cfd6202f42 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:40.073865 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbbcbe6-dea3-49a5-a86d-97a89ec87fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:40.074779 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbbcbe6-dea3-49a5-a86d-97a89ec87fac None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:40.075063 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbbcbe6-dea3-49a5-a86d-97a89ec87fac None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:40.075338 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbbcbe6-dea3-49a5-a86d-97a89ec87fac None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:40.084513 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbbcbe6-dea3-49a5-a86d-97a89ec87fac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:40.088139 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbbcbe6-dea3-49a5-a86d-97a89ec87fac None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:40.091834 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:40.098703 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f0314f-5fa7-4c58-9fe3-c0e432ba2315 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:40.106338 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-9cbbcbe6-dea3-49a5-a86d-97a89ec87fac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 04:05:40.106338 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:40.106338 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:40.106338 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:40.106338 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:40.106338 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:40.106338 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:40.106338 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:40.106338 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:40.106338 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:40.106338 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:40.106338 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:40.106338 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 04:05:40.106338 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 04:05:40.106338 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 04:05:40.107236 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 04:05:40.107236 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:40.107236 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:40.107236 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:40.107236 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:40.107236 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:40.107236 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:40.107236 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:40.107236 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:40.107236 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:40.107236 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:40.107236 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:40.107236 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:40.107236 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:40.107236 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:40.107236 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:40.107236 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:40.108069 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 04:05:40.108069 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 04:05:40.108069 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 04:05:40.108069 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 04:05:40.108069 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 04:05:40.108069 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 04:05:40.108069 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 04:05:40.108069 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:05:40.108069 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 259/523] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Jun 18 04:05:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:40.110401 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbbcbe6-dea3-49a5-a86d-97a89ec87fac None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:40.149004 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c6dd1-e62b-49f7-b259-fee0e118464c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:40.149678 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c6dd1-e62b-49f7-b259-fee0e118464c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:40.150328 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c6dd1-e62b-49f7-b259-fee0e118464c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:40.150328 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c6dd1-e62b-49f7-b259-fee0e118464c None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:40.151784 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009c6dd1-e62b-49f7-b259-fee0e118464c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:40.152663 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009c6dd1-e62b-49f7-b259-fee0e118464c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:40.153589 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009c6dd1-e62b-49f7-b259-fee0e118464c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:40.172717 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 265/524] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:05:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:40.173509 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c6dd1-e62b-49f7-b259-fee0e118464c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:40.234540 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbbcbe6-dea3-49a5-a86d-97a89ec87fac None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:40.249177 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:40.274214 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1d65d-85dc-49a5-b59e-dab99f6f85cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:40.274886 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1d65d-85dc-49a5-b59e-dab99f6f85cc None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:40.275210 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1d65d-85dc-49a5-b59e-dab99f6f85cc None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:40.275476 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1d65d-85dc-49a5-b59e-dab99f6f85cc None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:40.276337 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c1d65d-85dc-49a5-b59e-dab99f6f85cc None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:40.276678 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c1d65d-85dc-49a5-b59e-dab99f6f85cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:40.278148 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c1d65d-85dc-49a5-b59e-dab99f6f85cc None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:40.297037 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c6dd1-e62b-49f7-b259-fee0e118464c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:40.303296 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 260/525] 10.222.0.20 () {56 vars in 1139 bytes} [Sat Jun 18 04:05:40 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:40.303296 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1d65d-85dc-49a5-b59e-dab99f6f85cc None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:40.337445 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcfb0f8-7501-4d56-8ecf-d8f8282185b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:40.338351 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcfb0f8-7501-4d56-8ecf-d8f8282185b8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:40.338711 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcfb0f8-7501-4d56-8ecf-d8f8282185b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:40.338956 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcfb0f8-7501-4d56-8ecf-d8f8282185b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:40.354451 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcfb0f8-7501-4d56-8ecf-d8f8282185b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:40.355978 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcfb0f8-7501-4d56-8ecf-d8f8282185b8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:40.375753 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-6dcfb0f8-7501-4d56-8ecf-d8f8282185b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:40.375753 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:40.375753 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:40.375753 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:40.375753 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:40.375753 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:40.375753 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:40.375753 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:40.375753 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:40.375753 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:40.375753 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:40.375753 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:40.375753 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:05:40.375753 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:05:40.375753 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:05:40.376682 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:05:40.376682 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:40.376682 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:40.376682 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:40.376682 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:40.376682 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:40.376682 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:40.376682 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:40.376682 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:40.376682 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:40.376682 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:40.376682 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:40.376682 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:40.376682 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:40.376682 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:40.376682 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:40.376682 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:40.377625 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:05:40.377625 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:05:40.377625 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:40.377625 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:40.377625 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 266/526] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:05:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:40.378974 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcfb0f8-7501-4d56-8ecf-d8f8282185b8 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:40.391926 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:40.428606 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1d65d-85dc-49a5-b59e-dab99f6f85cc None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:40.470694 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6521fbc-81c6-4a08-b4af-e140cbf35144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:40.471716 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6521fbc-81c6-4a08-b4af-e140cbf35144 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:40.472186 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6521fbc-81c6-4a08-b4af-e140cbf35144 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:40.472515 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6521fbc-81c6-4a08-b4af-e140cbf35144 None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:40.473369 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6521fbc-81c6-4a08-b4af-e140cbf35144 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:40.473676 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6521fbc-81c6-4a08-b4af-e140cbf35144 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:40.475164 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6521fbc-81c6-4a08-b4af-e140cbf35144 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:40.487180 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcfb0f8-7501-4d56-8ecf-d8f8282185b8 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:40.498424 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 261/527] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Jun 18 04:05:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:40.498424 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6521fbc-81c6-4a08-b4af-e140cbf35144 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:40.526428 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:40.529099 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2163a-81db-41df-b32e-eb87fe07f27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:40.530528 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2163a-81db-41df-b32e-eb87fe07f27f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:40.530805 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2163a-81db-41df-b32e-eb87fe07f27f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:40.531173 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2163a-81db-41df-b32e-eb87fe07f27f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:40.538424 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca2163a-81db-41df-b32e-eb87fe07f27f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:40.539971 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca2163a-81db-41df-b32e-eb87fe07f27f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:40.555288 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-aca2163a-81db-41df-b32e-eb87fe07f27f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 04:05:40.555288 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:40.555288 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:40.555288 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:40.555288 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:40.555288 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:40.555288 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:40.555288 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:40.555288 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:40.555288 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:40.555288 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:40.555288 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:40.555288 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 04:05:40.555288 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 04:05:40.555288 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 04:05:40.556155 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 04:05:40.556155 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:40.556155 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:40.556155 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:40.556155 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:40.556155 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:40.556155 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:40.556155 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:40.556155 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:40.556155 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:40.556155 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:40.556155 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:40.556155 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:40.556155 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:40.556155 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:40.556155 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:40.556155 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:40.557787 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 04:05:40.557787 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 04:05:40.557787 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 04:05:40.557787 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 04:05:40.557787 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 04:05:40.557787 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 04:05:40.557787 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 04:05:40.557787 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:40.557787 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 267/528] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Jun 18 04:05:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:40.557787 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2163a-81db-41df-b32e-eb87fe07f27f None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:40.603117 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6521fbc-81c6-4a08-b4af-e140cbf35144 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:40.625078 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:40.639544 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f3b7ec-506c-4003-82dc-0ad1e97c9ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:40.640196 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3b7ec-506c-4003-82dc-0ad1e97c9ad1 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:40.640478 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3b7ec-506c-4003-82dc-0ad1e97c9ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:40.640782 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3b7ec-506c-4003-82dc-0ad1e97c9ad1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:40.661094 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2163a-81db-41df-b32e-eb87fe07f27f None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:40.699848 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd71bb-f135-4bae-a620-cdc6573c795c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:40.700525 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd71bb-f135-4bae-a620-cdc6573c795c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:40.700814 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd71bb-f135-4bae-a620-cdc6573c795c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:40.701102 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd71bb-f135-4bae-a620-cdc6573c795c None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:40.701818 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cd71bb-f135-4bae-a620-cdc6573c795c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:40.702116 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cd71bb-f135-4bae-a620-cdc6573c795c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:40.703480 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cd71bb-f135-4bae-a620-cdc6573c795c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:40.712441 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f3b7ec-506c-4003-82dc-0ad1e97c9ad1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:40.713966 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f3b7ec-506c-4003-82dc-0ad1e97c9ad1 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:40.715797 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 268/529] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:05:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:40.716880 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd71bb-f135-4bae-a620-cdc6573c795c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:40.754807 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:40.825897 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd71bb-f135-4bae-a620-cdc6573c795c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:40.829379 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 262/530] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Jun 18 04:05:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 04:05:40.830379 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f3b7ec-506c-4003-82dc-0ad1e97c9ad1 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:40.855685 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:40.867659 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4039cd-0ab0-418a-9a53-ceb36e9ee442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:40.868315 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4039cd-0ab0-418a-9a53-ceb36e9ee442 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:40.868611 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4039cd-0ab0-418a-9a53-ceb36e9ee442 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:40.868888 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4039cd-0ab0-418a-9a53-ceb36e9ee442 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:40.869735 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4039cd-0ab0-418a-9a53-ceb36e9ee442 None admin] RBAC: Adding query filter params (role.id=f055a7ed241c4492a4f92494099bab54, scope.project.id=9649aee8c5554102bc4193003300a3ad, user.id=2a6f686b7cfa455d82559e69ee0a4d7f) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:40.870088 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4039cd-0ab0-418a-9a53-ceb36e9ee442 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:40.872072 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4039cd-0ab0-418a-9a53-ceb36e9ee442 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:40.879005 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 269/531] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Jun 18 04:05:40 2022] GET /identity/v3/role_assignments?user.id=2a6f686b7cfa455d82559e69ee0a4d7f&scope.project.id=9649aee8c5554102bc4193003300a3ad&role.id=f055a7ed241c4492a4f92494099bab54 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:40.879821 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4039cd-0ab0-418a-9a53-ceb36e9ee442 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:40.963586 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f3b7ec-506c-4003-82dc-0ad1e97c9ad1 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:41.003511 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:41.010445 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272474d5-4b4b-4136-b105-4d303048679e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:41.011661 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272474d5-4b4b-4136-b105-4d303048679e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:41.012702 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272474d5-4b4b-4136-b105-4d303048679e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:41.013187 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272474d5-4b4b-4136-b105-4d303048679e None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:41.014626 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272474d5-4b4b-4136-b105-4d303048679e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:41.015038 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272474d5-4b4b-4136-b105-4d303048679e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:41.017394 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272474d5-4b4b-4136-b105-4d303048679e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:41.020151 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4039cd-0ab0-418a-9a53-ceb36e9ee442 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:41.033012 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 263/532] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Jun 18 04:05:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:41.035076 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272474d5-4b4b-4136-b105-4d303048679e None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:41.067761 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6197e8a-4a2d-4245-862a-f0ae7d77e170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:41.068592 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6197e8a-4a2d-4245-862a-f0ae7d77e170 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:41.068882 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6197e8a-4a2d-4245-862a-f0ae7d77e170 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:41.069153 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6197e8a-4a2d-4245-862a-f0ae7d77e170 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:41.078353 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6197e8a-4a2d-4245-862a-f0ae7d77e170 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:41.079815 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6197e8a-4a2d-4245-862a-f0ae7d77e170 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:41.096302 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-c6197e8a-4a2d-4245-862a-f0ae7d77e170 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 04:05:41.096302 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:41.096302 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:41.096302 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:41.096302 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:41.096302 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:41.096302 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:41.096302 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:41.096302 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:41.096302 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:41.096302 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:41.096302 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:41.096302 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 04:05:41.096302 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 04:05:41.096302 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 04:05:41.097274 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 04:05:41.097274 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:41.097274 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:41.097274 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:41.097274 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:41.097274 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:41.097274 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:41.097274 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:41.097274 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:41.097274 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:41.097274 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:41.097274 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:41.097274 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:41.097274 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:41.097274 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:41.097274 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:41.097274 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:41.098102 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 04:05:41.098102 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 04:05:41.098102 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 04:05:41.098102 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 04:05:41.098102 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 04:05:41.098102 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 04:05:41.098102 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 04:05:41.098102 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:41.102508 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 270/533] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Jun 18 04:05:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:41.103579 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6197e8a-4a2d-4245-862a-f0ae7d77e170 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:41.161953 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:41.165066 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272474d5-4b4b-4136-b105-4d303048679e None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:41.200627 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d81bbb-f3a2-4698-a528-68f1873038ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:41.201798 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d81bbb-f3a2-4698-a528-68f1873038ea None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:41.202302 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d81bbb-f3a2-4698-a528-68f1873038ea None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:41.202795 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d81bbb-f3a2-4698-a528-68f1873038ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:41.212179 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6197e8a-4a2d-4245-862a-f0ae7d77e170 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:41.214409 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d81bbb-f3a2-4698-a528-68f1873038ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:41.216128 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d81bbb-f3a2-4698-a528-68f1873038ea None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:41.234008 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-91d81bbb-f3a2-4698-a528-68f1873038ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:41.234008 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:41.234008 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:41.234008 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:41.234008 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:41.234008 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:41.234008 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:41.234008 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:41.234008 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:41.234008 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:41.234008 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:41.234008 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:41.234008 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:05:41.234008 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:05:41.234008 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:05:41.235266 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:05:41.235266 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:41.235266 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:41.235266 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:41.235266 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:41.235266 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:41.235266 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:41.235266 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:41.235266 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:41.235266 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:41.235266 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:41.235266 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:41.235266 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:41.235266 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:41.235266 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:41.235266 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:41.235266 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:41.236128 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:05:41.236128 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:05:41.236128 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:41.236128 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:05:41.238412 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 264/534] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:05:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:41.239415 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d81bbb-f3a2-4698-a528-68f1873038ea None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:41.253684 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659560f1-dc31-487e-9bf6-c24e84e4ce91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:41.254270 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659560f1-dc31-487e-9bf6-c24e84e4ce91 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:41.254595 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659560f1-dc31-487e-9bf6-c24e84e4ce91 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:41.254869 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659560f1-dc31-487e-9bf6-c24e84e4ce91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:41.255714 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659560f1-dc31-487e-9bf6-c24e84e4ce91 None admin] RBAC: Adding query filter params (role.id=f055a7ed241c4492a4f92494099bab54, scope.project.id=9649aee8c5554102bc4193003300a3ad, user.id=c129f3de2bb2431593fac649fd4975b3) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:41.256024 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659560f1-dc31-487e-9bf6-c24e84e4ce91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:41.257809 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659560f1-dc31-487e-9bf6-c24e84e4ce91 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:41.272972 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 271/535] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Jun 18 04:05:41 2022] GET /identity/v3/role_assignments?user.id=c129f3de2bb2431593fac649fd4975b3&scope.project.id=9649aee8c5554102bc4193003300a3ad&role.id=f055a7ed241c4492a4f92494099bab54 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:41.273948 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659560f1-dc31-487e-9bf6-c24e84e4ce91 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:41.305071 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:41.356248 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d81bbb-f3a2-4698-a528-68f1873038ea None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:41.399085 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712f7522-9964-4a76-a4ab-757a55e947a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:41.400901 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f7522-9964-4a76-a4ab-757a55e947a4 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:41.401393 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f7522-9964-4a76-a4ab-757a55e947a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:41.401870 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f7522-9964-4a76-a4ab-757a55e947a4 None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:41.402905 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712f7522-9964-4a76-a4ab-757a55e947a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:41.403422 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712f7522-9964-4a76-a4ab-757a55e947a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:41.405176 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712f7522-9964-4a76-a4ab-757a55e947a4 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:41.421501 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 265/536] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Jun 18 04:05:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:41.430602 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712f7522-9964-4a76-a4ab-757a55e947a4 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:41.526873 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659560f1-dc31-487e-9bf6-c24e84e4ce91 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:41.559421 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:41.591398 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ff246-b487-49d5-aae5-974abea5777e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:41.592070 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ff246-b487-49d5-aae5-974abea5777e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:41.592346 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ff246-b487-49d5-aae5-974abea5777e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:41.594413 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712f7522-9964-4a76-a4ab-757a55e947a4 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:41.595874 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ff246-b487-49d5-aae5-974abea5777e None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:41.596664 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239ff246-b487-49d5-aae5-974abea5777e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:41.596976 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239ff246-b487-49d5-aae5-974abea5777e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:41.598368 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239ff246-b487-49d5-aae5-974abea5777e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:41.600874 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:41.627155 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 272/537] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:05:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:41.628502 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ff246-b487-49d5-aae5-974abea5777e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:41.667250 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad94e4dd-d3c7-440f-a119-046d9145c26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:41.667919 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad94e4dd-d3c7-440f-a119-046d9145c26a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:41.668198 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad94e4dd-d3c7-440f-a119-046d9145c26a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:41.668470 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad94e4dd-d3c7-440f-a119-046d9145c26a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:41.672242 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad94e4dd-d3c7-440f-a119-046d9145c26a None admin] RBAC: Adding query filter params (role.id=f055a7ed241c4492a4f92494099bab54, scope.project.id=9649aee8c5554102bc4193003300a3ad, user.id=d0e9cb2b54724d4f9f71b7b1000cf72c) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:41.672599 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad94e4dd-d3c7-440f-a119-046d9145c26a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:41.674139 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad94e4dd-d3c7-440f-a119-046d9145c26a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:41.692747 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 266/538] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Jun 18 04:05:41 2022] GET /identity/v3/role_assignments?user.id=d0e9cb2b54724d4f9f71b7b1000cf72c&scope.project.id=9649aee8c5554102bc4193003300a3ad&role.id=f055a7ed241c4492a4f92494099bab54 => generated 259 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:41.789564 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ff246-b487-49d5-aae5-974abea5777e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:41.834974 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61587aed-fd2c-4d56-8a08-94202ad4c679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:41.835790 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61587aed-fd2c-4d56-8a08-94202ad4c679 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:41.836215 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61587aed-fd2c-4d56-8a08-94202ad4c679 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:41.836487 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61587aed-fd2c-4d56-8a08-94202ad4c679 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:41.844435 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61587aed-fd2c-4d56-8a08-94202ad4c679 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:41.846079 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61587aed-fd2c-4d56-8a08-94202ad4c679 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:41.862167 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-61587aed-fd2c-4d56-8a08-94202ad4c679 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 04:05:41.862167 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:41.862167 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:41.862167 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:41.862167 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:41.862167 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:41.862167 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:41.862167 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:41.862167 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:41.862167 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:41.862167 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:41.862167 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:41.862167 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 04:05:41.862167 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 04:05:41.862167 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 04:05:41.863056 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 04:05:41.863056 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:41.863056 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:41.863056 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:41.863056 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:41.863056 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:41.863056 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:41.863056 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:41.863056 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:41.863056 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:41.863056 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:41.863056 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:41.863056 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:41.863056 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:41.863056 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:41.863056 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:41.863056 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:41.863880 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 04:05:41.863880 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 04:05:41.863880 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 04:05:41.863880 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 04:05:41.863880 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 04:05:41.863880 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 04:05:41.863880 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 04:05:41.863880 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:41.866676 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 273/539] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Jun 18 04:05:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 04:05:41.873771 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad94e4dd-d3c7-440f-a119-046d9145c26a None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:42.024512 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad94e4dd-d3c7-440f-a119-046d9145c26a None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:42.064320 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033511e5-e646-4202-a0fd-9d36e65a09cf None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:42.065047 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033511e5-e646-4202-a0fd-9d36e65a09cf None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:42.065516 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033511e5-e646-4202-a0fd-9d36e65a09cf None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:42.065844 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3c35f-061d-4ee2-b3bc-bc6f17350e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:42.066517 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3c35f-061d-4ee2-b3bc-bc6f17350e30 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:42.066796 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3c35f-061d-4ee2-b3bc-bc6f17350e30 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:42.067064 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3c35f-061d-4ee2-b3bc-bc6f17350e30 None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:42.067951 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c3c35f-061d-4ee2-b3bc-bc6f17350e30 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:42.068165 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c3c35f-061d-4ee2-b3bc-bc6f17350e30 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:42.068517 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 274/540] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 18 04:05:42.072663 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c3c35f-061d-4ee2-b3bc-bc6f17350e30 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:42.073840 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb65aea9-13f3-4b9f-a3d0-a5d7d5b8dcb9 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:42.074313 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb65aea9-13f3-4b9f-a3d0-a5d7d5b8dcb9 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:42.074775 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb65aea9-13f3-4b9f-a3d0-a5d7d5b8dcb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:42.092286 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-fb65aea9-13f3-4b9f-a3d0-a5d7d5b8dcb9 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:42.092474 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 267/541] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Jun 18 04:05:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:42.094002 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-fb65aea9-13f3-4b9f-a3d0-a5d7d5b8dcb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:42.098079 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3c35f-061d-4ee2-b3bc-bc6f17350e30 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:42.151759 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:42.168960 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:42.214786 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 275/542] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 18 04:05:42.269346 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3c35f-061d-4ee2-b3bc-bc6f17350e30 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:42.274152 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb65aea9-13f3-4b9f-a3d0-a5d7d5b8dcb9 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:42.353451 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c5d0a-abb6-4404-b5d2-67455bc5b6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:42.353985 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c5d0a-abb6-4404-b5d2-67455bc5b6db None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:42.354263 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c5d0a-abb6-4404-b5d2-67455bc5b6db None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:42.354533 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c5d0a-abb6-4404-b5d2-67455bc5b6db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:42.355373 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693c5d0a-abb6-4404-b5d2-67455bc5b6db None admin] RBAC: Adding query filter params (role.id=f055a7ed241c4492a4f92494099bab54, scope.project.id=9649aee8c5554102bc4193003300a3ad, user.id=0798570229d943319caac5787bdcb9df) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:42.355680 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693c5d0a-abb6-4404-b5d2-67455bc5b6db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:42.357178 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693c5d0a-abb6-4404-b5d2-67455bc5b6db None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:42.374842 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 268/543] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Jun 18 04:05:42 2022] GET /identity/v3/role_assignments?user.id=0798570229d943319caac5787bdcb9df&scope.project.id=9649aee8c5554102bc4193003300a3ad&role.id=f055a7ed241c4492a4f92494099bab54 => generated 259 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:05:42.381496 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb65aea9-13f3-4b9f-a3d0-a5d7d5b8dcb9 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:42.450312 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c6dbcf-154f-45c0-8698-87cf9780a1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:42.451154 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c6dbcf-154f-45c0-8698-87cf9780a1e2 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:42.451437 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c6dbcf-154f-45c0-8698-87cf9780a1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:42.451709 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c6dbcf-154f-45c0-8698-87cf9780a1e2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:42.470838 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c6dbcf-154f-45c0-8698-87cf9780a1e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:05:42.479112 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-19c6dbcf-154f-45c0-8698-87cf9780a1e2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 18 04:05:42.479112 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:42.479112 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:42.479112 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:42.479112 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:42.479112 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:42.479112 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:42.479112 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:42.479112 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:42.479112 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:42.479112 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:42.479112 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:42.479112 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:05:42.479112 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:05:42.479112 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:05:42.479112 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:05:42.480038 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:05:42.480038 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:05:42.480038 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:05:42.480038 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:05:42.480038 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:42.480038 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:42.480038 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:42.480038 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:42.480038 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:42.480038 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:42.480038 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:42.480038 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:42.480038 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:42.480038 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:42.480038 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:42.480038 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:42.480884 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:42.480884 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:42.480884 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:42.480884 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:42.480884 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:05:42.480884 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:05:42.480884 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:05:42.480884 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:05:42.480884 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:05:42.480884 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:05:42.480884 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 18 04:05:42.480884 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:42.484971 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 276/544] 10.222.0.20 () {56 vars in 1102 bytes} [Sat Jun 18 04:05:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 04:05:42.488028 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c5d0a-abb6-4404-b5d2-67455bc5b6db None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:42.632079 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:42.641988 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c5d0a-abb6-4404-b5d2-67455bc5b6db None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:42.688851 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e687afe5-4a22-4725-bd5b-36f5fc2db7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:42.689525 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687afe5-4a22-4725-bd5b-36f5fc2db7d9 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:42.689809 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687afe5-4a22-4725-bd5b-36f5fc2db7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:42.690084 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687afe5-4a22-4725-bd5b-36f5fc2db7d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:42.690836 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e687afe5-4a22-4725-bd5b-36f5fc2db7d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:42.691139 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e687afe5-4a22-4725-bd5b-36f5fc2db7d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:42.692521 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e687afe5-4a22-4725-bd5b-36f5fc2db7d9 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:42.707214 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 269/545] 10.222.0.20 () {56 vars in 1103 bytes} [Sat Jun 18 04:05:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:42.712533 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c6dbcf-154f-45c0-8698-87cf9780a1e2 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:42.756853 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:42.834449 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c6dbcf-154f-45c0-8698-87cf9780a1e2 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:42.869290 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef237b-2979-46ef-9d40-ca330aad5481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:42.870098 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef237b-2979-46ef-9d40-ca330aad5481 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:42.870379 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef237b-2979-46ef-9d40-ca330aad5481 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:42.870653 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef237b-2979-46ef-9d40-ca330aad5481 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:42.881705 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ef237b-2979-46ef-9d40-ca330aad5481 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:42.883233 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ef237b-2979-46ef-9d40-ca330aad5481 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:42.900478 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-14ef237b-2979-46ef-9d40-ca330aad5481 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:42.900478 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:42.900478 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:42.900478 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:42.900478 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:42.900478 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:42.900478 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:42.900478 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:42.900478 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:42.900478 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:42.900478 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:42.900478 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:42.900478 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:05:42.900478 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:05:42.900478 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:05:42.901337 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:05:42.901337 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:42.901337 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:42.901337 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:42.901337 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:42.901337 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:42.901337 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:42.901337 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:42.901337 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:42.901337 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:42.901337 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:42.901337 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:42.901337 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:42.901337 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:42.901337 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:42.901337 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:42.901337 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:42.902143 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:05:42.902143 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:05:42.902143 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:42.902143 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:42.902143 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 277/546] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:05:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:42.909716 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e687afe5-4a22-4725-bd5b-36f5fc2db7d9 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:43.063750 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e687afe5-4a22-4725-bd5b-36f5fc2db7d9 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:43.112381 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7d82d-e82f-4c5f-a614-0f6883216dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:43.113070 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7d82d-e82f-4c5f-a614-0f6883216dc6 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:43.113349 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7d82d-e82f-4c5f-a614-0f6883216dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:43.113619 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7d82d-e82f-4c5f-a614-0f6883216dc6 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:43.114351 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc7d82d-e82f-4c5f-a614-0f6883216dc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:43.114651 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc7d82d-e82f-4c5f-a614-0f6883216dc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:43.116027 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc7d82d-e82f-4c5f-a614-0f6883216dc6 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:43.128101 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 270/547] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:05:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:43.133580 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef237b-2979-46ef-9d40-ca330aad5481 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:43.254112 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:43.279459 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef237b-2979-46ef-9d40-ca330aad5481 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:43.327615 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3f833-4cb9-4f01-9f50-aff741f33e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:43.328421 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3f833-4cb9-4f01-9f50-aff741f33e55 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:43.328736 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3f833-4cb9-4f01-9f50-aff741f33e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:43.329018 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3f833-4cb9-4f01-9f50-aff741f33e55 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:43.341743 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3f833-4cb9-4f01-9f50-aff741f33e55 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:43.343193 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3f833-4cb9-4f01-9f50-aff741f33e55 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:43.348092 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3df9a1-f0dc-4575-bd6f-7a09a5d3ad94 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:43.348371 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3df9a1-f0dc-4575-bd6f-7a09a5d3ad94 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:43.348666 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3df9a1-f0dc-4575-bd6f-7a09a5d3ad94 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:43.350047 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 271/548] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 18 04:05:43.359937 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94dd1bc-485b-466b-924f-20b258b3bb69 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:43.360495 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94dd1bc-485b-466b-924f-20b258b3bb69 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:43.360988 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94dd1bc-485b-466b-924f-20b258b3bb69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:43.361880 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-57c3f833-4cb9-4f01-9f50-aff741f33e55 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 18 04:05:43.361880 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:43.361880 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:43.361880 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:43.361880 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:43.361880 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:43.361880 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:43.361880 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:43.361880 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:43.361880 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:43.361880 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:43.361880 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:43.361880 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 04:05:43.361880 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 04:05:43.361880 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 04:05:43.361880 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 04:05:43.362749 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:43.362749 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:43.362749 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 04:05:43.362749 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 04:05:43.362749 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 04:05:43.362749 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 04:05:43.362749 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:43.362749 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:43.362749 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:43.362749 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:43.362749 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:43.362749 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:43.362749 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:43.362749 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:43.362749 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:43.362749 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:43.362749 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:43.362749 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:43.364316 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:43.364316 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:43.364316 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 04:05:43.364316 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 04:05:43.364316 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 04:05:43.364316 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 04:05:43.364316 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 04:05:43.364316 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 04:05:43.364316 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 18 04:05:43.364316 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:43.364316 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 278/549] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Jun 18 04:05:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:43.369566 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3f833-4cb9-4f01-9f50-aff741f33e55 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:43.390832 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-e94dd1bc-485b-466b-924f-20b258b3bb69 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:43.392238 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-e94dd1bc-485b-466b-924f-20b258b3bb69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:43.404971 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:43.531266 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 272/550] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:05:43.549099 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3f833-4cb9-4f01-9f50-aff741f33e55 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:43.558159 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94dd1bc-485b-466b-924f-20b258b3bb69 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:43.619694 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cad637-771a-40a5-8683-2c886004c6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:43.620383 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cad637-771a-40a5-8683-2c886004c6de None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:43.620685 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cad637-771a-40a5-8683-2c886004c6de None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:43.620958 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cad637-771a-40a5-8683-2c886004c6de None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:43.621809 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cad637-771a-40a5-8683-2c886004c6de None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:43.622116 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cad637-771a-40a5-8683-2c886004c6de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:43.623560 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cad637-771a-40a5-8683-2c886004c6de None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:43.641010 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:43.659514 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 279/551] 10.222.0.20 () {56 vars in 1135 bytes} [Sat Jun 18 04:05:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:43.663487 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cad637-771a-40a5-8683-2c886004c6de None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:43.752756 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94dd1bc-485b-466b-924f-20b258b3bb69 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:43.767749 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cad637-771a-40a5-8683-2c886004c6de None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:43.805502 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b57cf-53d7-4ffa-8b38-616634be4146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:43.806165 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b57cf-53d7-4ffa-8b38-616634be4146 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:43.806490 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b57cf-53d7-4ffa-8b38-616634be4146 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:43.806763 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b57cf-53d7-4ffa-8b38-616634be4146 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:43.819936 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177f55d4-cd1e-465b-8e75-64a219138ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:43.820770 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f55d4-cd1e-465b-8e75-64a219138ce9 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:43.821051 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f55d4-cd1e-465b-8e75-64a219138ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:43.821322 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f55d4-cd1e-465b-8e75-64a219138ce9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:43.841495 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177f55d4-cd1e-465b-8e75-64a219138ce9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:05:43.851863 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-177f55d4-cd1e-465b-8e75-64a219138ce9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 18 04:05:43.851863 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:43.851863 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:43.851863 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:43.851863 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:43.851863 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:43.851863 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:43.851863 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:43.851863 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:43.851863 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:43.851863 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:43.851863 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:43.851863 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:05:43.851863 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:05:43.851863 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:05:43.851863 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:05:43.852894 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:05:43.852894 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:05:43.852894 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:05:43.852894 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:05:43.852894 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:43.852894 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:43.852894 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:43.852894 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:43.852894 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:43.852894 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:43.852894 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:43.852894 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:43.852894 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:43.852894 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:43.852894 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:43.852894 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:43.853924 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:43.853924 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:43.853924 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:43.853924 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:43.853924 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:05:43.853924 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:05:43.853924 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:05:43.853924 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:05:43.853924 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:05:43.853924 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:05:43.853924 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 18 04:05:43.853924 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:05:43.853924 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 273/552] 10.222.0.20 () {56 vars in 1102 bytes} [Sat Jun 18 04:05:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 04:05:43.855084 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e144c-7883-48f4-b1c2-19376e109d84 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:43.855258 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e144c-7883-48f4-b1c2-19376e109d84 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:43.856360 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e144c-7883-48f4-b1c2-19376e109d84 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:43.860776 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 274/553] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:05:43.862412 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e144c-7883-48f4-b1c2-19376e109d84 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:43.866570 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:43.895559 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:43.906368 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69b57cf-53d7-4ffa-8b38-616634be4146 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:43.907879 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69b57cf-53d7-4ffa-8b38-616634be4146 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:44.005825 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e144c-7883-48f4-b1c2-19376e109d84 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:44.033191 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 280/554] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Jun 18 04:05:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 04:05:44.033191 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa266eef-b8e0-479c-8684-e3fe80a67c22 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:44.033191 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa266eef-b8e0-479c-8684-e3fe80a67c22 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:44.033191 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa266eef-b8e0-479c-8684-e3fe80a67c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:44.046488 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ccbaa3-808e-467d-a624-1fb06c24411a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:44.046660 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-fa266eef-b8e0-479c-8684-e3fe80a67c22 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:44.047161 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ccbaa3-808e-467d-a624-1fb06c24411a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:44.047439 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ccbaa3-808e-467d-a624-1fb06c24411a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:44.047712 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ccbaa3-808e-467d-a624-1fb06c24411a None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:44.047804 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-fa266eef-b8e0-479c-8684-e3fe80a67c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:44.048503 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ccbaa3-808e-467d-a624-1fb06c24411a None admin] RBAC: Adding query filter params (name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:44.048845 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ccbaa3-808e-467d-a624-1fb06c24411a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:44.050237 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ccbaa3-808e-467d-a624-1fb06c24411a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:44.062865 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 275/555] 10.222.0.20 () {56 vars in 1103 bytes} [Sat Jun 18 04:05:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:44.062865 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049860d-6a64-45a6-9373-c406bfe83aee None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:44.062865 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049860d-6a64-45a6-9373-c406bfe83aee None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:44.062865 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049860d-6a64-45a6-9373-c406bfe83aee None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:44.062865 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 276/556] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:05:44.062865 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049860d-6a64-45a6-9373-c406bfe83aee None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:44.124649 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 281/557] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:05:44.124649 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa266eef-b8e0-479c-8684-e3fe80a67c22 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:44.141357 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:44.156414 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:44.182663 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049860d-6a64-45a6-9373-c406bfe83aee None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:44.218392 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8174709e-2558-49f9-b860-65a81bc57511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:44.219173 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174709e-2558-49f9-b860-65a81bc57511 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:44.219453 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174709e-2558-49f9-b860-65a81bc57511 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:44.219723 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174709e-2558-49f9-b860-65a81bc57511 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:44.229482 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa266eef-b8e0-479c-8684-e3fe80a67c22 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:44.232284 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8174709e-2558-49f9-b860-65a81bc57511 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:44.233808 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8174709e-2558-49f9-b860-65a81bc57511 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:44.254407 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-8174709e-2558-49f9-b860-65a81bc57511 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:44.254407 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:44.254407 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:44.254407 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:44.254407 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:44.254407 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:44.254407 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:44.254407 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:44.254407 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:44.254407 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:44.254407 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:44.254407 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:44.254407 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:05:44.254407 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:05:44.254407 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:05:44.255552 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:05:44.255552 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:44.255552 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:44.255552 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:44.255552 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:44.255552 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:44.255552 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:44.255552 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:44.255552 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:44.255552 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:44.255552 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:44.255552 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:44.255552 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:44.255552 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:44.255552 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:44.255552 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:44.255552 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:44.256742 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:05:44.256742 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:05:44.256742 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:44.256742 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:05:44.260374 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 277/558] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:05:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:44.261886 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea2166-1fad-4ac2-9db1-81e6fff35bd7 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:44.262301 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea2166-1fad-4ac2-9db1-81e6fff35bd7 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:44.262580 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea2166-1fad-4ac2-9db1-81e6fff35bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:44.273101 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e449094-1cab-433a-8a86-63a535ea5fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:44.273913 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e449094-1cab-433a-8a86-63a535ea5fa0 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:44.274614 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e449094-1cab-433a-8a86-63a535ea5fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:44.274891 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e449094-1cab-433a-8a86-63a535ea5fa0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:44.279372 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-a7ea2166-1fad-4ac2-9db1-81e6fff35bd7 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:44.280553 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-a7ea2166-1fad-4ac2-9db1-81e6fff35bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:44.286249 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e449094-1cab-433a-8a86-63a535ea5fa0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:44.287751 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e449094-1cab-433a-8a86-63a535ea5fa0 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:44.306014 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-0e449094-1cab-433a-8a86-63a535ea5fa0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:44.306014 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:44.306014 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:44.306014 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:44.306014 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:44.306014 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:44.306014 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:44.306014 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:44.306014 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:44.306014 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:44.306014 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:44.306014 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:44.306014 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:05:44.306014 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:05:44.306014 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:05:44.307492 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:05:44.307492 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:44.307492 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:44.307492 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:44.307492 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:44.307492 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:44.307492 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:44.307492 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:44.307492 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:44.307492 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:44.307492 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:44.307492 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:44.307492 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:44.307492 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:44.307492 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:44.307492 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:44.307492 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:44.309122 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:05:44.309122 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:05:44.309122 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:44.309122 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:44.309122 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 282/559] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:05:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:44.309122 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e449094-1cab-433a-8a86-63a535ea5fa0 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:44.358038 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 278/560] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:05:44.359731 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea2166-1fad-4ac2-9db1-81e6fff35bd7 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:44.401748 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:44.413247 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:44.428003 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e449094-1cab-433a-8a86-63a535ea5fa0 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:44.461656 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b154d7da-a64a-4205-949c-adfa991213ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:44.462455 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154d7da-a64a-4205-949c-adfa991213ac None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:44.462768 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154d7da-a64a-4205-949c-adfa991213ac None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:44.463038 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154d7da-a64a-4205-949c-adfa991213ac None admin] PATH_INFO: `/v3/roles/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:44.466795 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea2166-1fad-4ac2-9db1-81e6fff35bd7 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:44.473574 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b154d7da-a64a-4205-949c-adfa991213ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:05:44.482085 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-b154d7da-a64a-4205-949c-adfa991213ac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 18 04:05:44.482085 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:44.482085 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:44.482085 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:44.482085 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:44.482085 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:44.482085 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:44.482085 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:44.482085 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:44.482085 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:44.482085 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:44.482085 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:44.482085 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:05:44.482085 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:05:44.482085 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:05:44.482085 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:05:44.483157 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:05:44.483157 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:05:44.483157 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:05:44.483157 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:05:44.483157 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:44.483157 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:44.483157 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:44.483157 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:44.483157 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:44.483157 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:44.483157 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:44.483157 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:44.483157 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:44.483157 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:44.483157 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:44.483157 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:44.484526 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:44.484526 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:44.484526 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:44.484526 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:44.484526 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:05:44.484526 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:05:44.484526 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:05:44.484526 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:05:44.484526 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:05:44.484526 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:05:44.484526 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 18 04:05:44.484526 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:44.488419 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 283/561] 10.222.0.20 () {56 vars in 1102 bytes} [Sat Jun 18 04:05:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:44.489339 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b154d7da-a64a-4205-949c-adfa991213ac None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:44.507151 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd9776f-9116-47a0-9d01-22e2104b327d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:44.507807 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9776f-9116-47a0-9d01-22e2104b327d None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:44.508083 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9776f-9116-47a0-9d01-22e2104b327d None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:44.508386 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9776f-9116-47a0-9d01-22e2104b327d None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:44.509119 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd9776f-9116-47a0-9d01-22e2104b327d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:44.509565 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd9776f-9116-47a0-9d01-22e2104b327d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:44.510853 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd9776f-9116-47a0-9d01-22e2104b327d None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:44.522627 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 279/562] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:05:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:44.523445 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd9776f-9116-47a0-9d01-22e2104b327d None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:44.598860 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b154d7da-a64a-4205-949c-adfa991213ac None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:44.630807 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd9776f-9116-47a0-9d01-22e2104b327d None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:44.632125 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a2a7b-4fb1-43be-a737-a71bea3ec7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:44.632828 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a2a7b-4fb1-43be-a737-a71bea3ec7d0 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:44.633114 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a2a7b-4fb1-43be-a737-a71bea3ec7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:44.633389 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a2a7b-4fb1-43be-a737-a71bea3ec7d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:44.634110 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583a2a7b-4fb1-43be-a737-a71bea3ec7d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:44.634417 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583a2a7b-4fb1-43be-a737-a71bea3ec7d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:44.635858 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583a2a7b-4fb1-43be-a737-a71bea3ec7d0 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:44.641370 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:44.642762 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:44.652367 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 284/563] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:05:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:44.652367 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a2a7b-4fb1-43be-a737-a71bea3ec7d0 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:44.670739 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29faf604-2b73-45bb-b146-8354f1f0fbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:44.671553 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29faf604-2b73-45bb-b146-8354f1f0fbee None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:44.671833 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29faf604-2b73-45bb-b146-8354f1f0fbee None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:44.672098 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29faf604-2b73-45bb-b146-8354f1f0fbee None admin] PATH_INFO: `/v3/roles/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:44.682730 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29faf604-2b73-45bb-b146-8354f1f0fbee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:05:44.690531 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-29faf604-2b73-45bb-b146-8354f1f0fbee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 18 04:05:44.690531 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:44.690531 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:44.690531 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:44.690531 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:44.690531 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:44.690531 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:44.690531 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:44.690531 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:44.690531 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:44.690531 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:44.690531 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:44.690531 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:05:44.690531 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:05:44.690531 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:05:44.690531 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:05:44.691704 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:05:44.691704 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:05:44.691704 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:05:44.691704 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:05:44.691704 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:44.691704 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:44.691704 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:44.691704 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:44.691704 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:44.691704 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:44.691704 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:44.691704 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:44.691704 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:44.691704 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:44.691704 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:44.691704 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:44.692526 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:44.692526 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:44.692526 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:44.692526 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:44.692526 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:05:44.692526 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:05:44.692526 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:05:44.692526 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:05:44.692526 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:05:44.692526 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:05:44.692526 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 18 04:05:44.692526 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:05:44.692526 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 280/564] 10.222.0.20 () {56 vars in 1102 bytes} [Sat Jun 18 04:05:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:44.692526 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29faf604-2b73-45bb-b146-8354f1f0fbee None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:44.761181 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a2a7b-4fb1-43be-a737-a71bea3ec7d0 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:44.795726 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc177af-cd7e-49dd-9c6e-5c110edf8eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:44.796619 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc177af-cd7e-49dd-9c6e-5c110edf8eac None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:44.796716 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc177af-cd7e-49dd-9c6e-5c110edf8eac None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:44.796947 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc177af-cd7e-49dd-9c6e-5c110edf8eac None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:44.797702 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc177af-cd7e-49dd-9c6e-5c110edf8eac None admin] RBAC: Adding query filter params (name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:44.798006 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc177af-cd7e-49dd-9c6e-5c110edf8eac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:44.799387 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc177af-cd7e-49dd-9c6e-5c110edf8eac None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:44.807467 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29faf604-2b73-45bb-b146-8354f1f0fbee None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:44.808114 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 285/565] 10.222.0.20 () {56 vars in 1103 bytes} [Sat Jun 18 04:05:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:44.808971 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc177af-cd7e-49dd-9c6e-5c110edf8eac None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:44.846827 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42fca9b-8df6-4c10-bba0-0e5643868cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:44.847633 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42fca9b-8df6-4c10-bba0-0e5643868cc7 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:44.847909 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42fca9b-8df6-4c10-bba0-0e5643868cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:44.848173 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42fca9b-8df6-4c10-bba0-0e5643868cc7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:44.855096 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42fca9b-8df6-4c10-bba0-0e5643868cc7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:44.856523 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42fca9b-8df6-4c10-bba0-0e5643868cc7 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:44.870863 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-c42fca9b-8df6-4c10-bba0-0e5643868cc7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 04:05:44.870863 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:44.870863 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:44.870863 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:44.870863 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:44.870863 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:44.870863 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:44.870863 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:44.870863 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:44.870863 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:44.870863 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:44.870863 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:44.870863 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 04:05:44.870863 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 04:05:44.870863 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 04:05:44.871838 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 04:05:44.871838 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:44.871838 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:44.871838 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:44.871838 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:44.871838 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:44.871838 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:44.871838 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:44.871838 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:44.871838 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:44.871838 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:44.871838 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:44.871838 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:44.871838 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:44.871838 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:44.871838 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:44.871838 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:44.872876 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 04:05:44.872876 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 04:05:44.872876 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 04:05:44.872876 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 04:05:44.872876 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 04:05:44.872876 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 04:05:44.872876 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 04:05:44.872876 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:05:44.872876 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 281/566] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Jun 18 04:05:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:44.872876 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42fca9b-8df6-4c10-bba0-0e5643868cc7 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:44.876476 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:44.902003 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:44.916773 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc177af-cd7e-49dd-9c6e-5c110edf8eac None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:44.950164 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e50f813-055d-4c18-b04d-ebc2ef643ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:44.950977 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50f813-055d-4c18-b04d-ebc2ef643ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:44.951243 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50f813-055d-4c18-b04d-ebc2ef643ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:44.951506 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50f813-055d-4c18-b04d-ebc2ef643ed4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:44.959236 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e50f813-055d-4c18-b04d-ebc2ef643ed4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:44.963347 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e50f813-055d-4c18-b04d-ebc2ef643ed4 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:44.972277 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42fca9b-8df6-4c10-bba0-0e5643868cc7 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:44.975018 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-8e50f813-055d-4c18-b04d-ebc2ef643ed4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 18 04:05:44.975018 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:44.975018 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:44.975018 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:44.975018 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:44.975018 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:44.975018 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:44.975018 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:44.975018 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:44.975018 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:44.975018 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:44.975018 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:44.975018 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 04:05:44.975018 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 04:05:44.975018 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 04:05:44.975018 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 04:05:44.975958 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:44.975958 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:44.975958 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 04:05:44.975958 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 04:05:44.975958 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 04:05:44.975958 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 04:05:44.975958 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:44.975958 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:44.975958 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:44.975958 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:44.975958 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:44.975958 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:44.975958 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:44.975958 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:44.975958 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:44.975958 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:44.975958 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:44.975958 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:44.976915 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:44.976915 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:44.976915 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 04:05:44.976915 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 04:05:44.976915 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 04:05:44.976915 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 04:05:44.976915 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 04:05:44.976915 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 04:05:44.976915 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 18 04:05:44.976915 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:44.976915 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 286/567] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Jun 18 04:05:44 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:44.977669 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e50f813-055d-4c18-b04d-ebc2ef643ed4 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:45.008555 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c0ca96-c887-41fe-b8c3-4d2f783300d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:45.009257 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0ca96-c887-41fe-b8c3-4d2f783300d4 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:45.009586 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0ca96-c887-41fe-b8c3-4d2f783300d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:45.009861 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0ca96-c887-41fe-b8c3-4d2f783300d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:45.010591 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c0ca96-c887-41fe-b8c3-4d2f783300d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:45.010892 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c0ca96-c887-41fe-b8c3-4d2f783300d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:45.012260 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c0ca96-c887-41fe-b8c3-4d2f783300d4 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:45.021175 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 282/568] 10.222.0.20 () {56 vars in 1103 bytes} [Sat Jun 18 04:05:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:45.022400 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4749e0a-cc67-4918-8e23-84772474c297 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:45.022691 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4749e0a-cc67-4918-8e23-84772474c297 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:45.022968 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4749e0a-cc67-4918-8e23-84772474c297 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:45.024332 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 283/569] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:05:45.024905 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4749e0a-cc67-4918-8e23-84772474c297 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:45.081766 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e50f813-055d-4c18-b04d-ebc2ef643ed4 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:45.101261 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:45.116087 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727a6d99-1c2a-4c4f-87aa-0e957f2298d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:45.116278 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:45.117090 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a6d99-1c2a-4c4f-87aa-0e957f2298d4 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:45.117360 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a6d99-1c2a-4c4f-87aa-0e957f2298d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:45.117866 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a6d99-1c2a-4c4f-87aa-0e957f2298d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:45.127034 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4749e0a-cc67-4918-8e23-84772474c297 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:45.128742 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727a6d99-1c2a-4c4f-87aa-0e957f2298d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:45.130190 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727a6d99-1c2a-4c4f-87aa-0e957f2298d4 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:45.146910 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-727a6d99-1c2a-4c4f-87aa-0e957f2298d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:45.146910 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:45.146910 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:45.146910 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:45.146910 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:45.146910 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:45.146910 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:45.146910 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:45.146910 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:45.146910 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:45.146910 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:45.146910 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:45.146910 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:05:45.146910 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:05:45.146910 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:05:45.147834 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:05:45.147834 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:45.147834 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:45.147834 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:45.147834 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:45.147834 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:45.147834 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:45.147834 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:45.147834 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:45.147834 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:45.147834 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:45.147834 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:45.147834 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:45.147834 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:45.147834 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:45.147834 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:45.147834 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:45.148757 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:05:45.148757 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:05:45.148757 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:45.148757 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:45.148757 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 287/570] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:05:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:45.149028 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727a6d99-1c2a-4c4f-87aa-0e957f2298d4 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:45.161005 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ed2b1-e857-4fe1-9704-a2b27119c2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:45.161666 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ed2b1-e857-4fe1-9704-a2b27119c2a6 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:45.161943 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ed2b1-e857-4fe1-9704-a2b27119c2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:45.162217 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ed2b1-e857-4fe1-9704-a2b27119c2a6 None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:45.163003 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8ed2b1-e857-4fe1-9704-a2b27119c2a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:45.163310 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8ed2b1-e857-4fe1-9704-a2b27119c2a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:45.164795 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8ed2b1-e857-4fe1-9704-a2b27119c2a6 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:45.176832 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 284/571] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Jun 18 04:05:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:45.177477 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ed2b1-e857-4fe1-9704-a2b27119c2a6 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:45.260818 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727a6d99-1c2a-4c4f-87aa-0e957f2298d4 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:45.274895 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ed2b1-e857-4fe1-9704-a2b27119c2a6 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:45.294016 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a593f3-1d73-45e1-845d-23ce849b31b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:45.294683 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a593f3-1d73-45e1-845d-23ce849b31b1 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:45.294959 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a593f3-1d73-45e1-845d-23ce849b31b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:45.295214 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a593f3-1d73-45e1-845d-23ce849b31b1 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:45.296047 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a593f3-1d73-45e1-845d-23ce849b31b1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:45.296347 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a593f3-1d73-45e1-845d-23ce849b31b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:45.297845 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a593f3-1d73-45e1-845d-23ce849b31b1 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:45.309811 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3a581a-9aee-44ca-8ddc-21c63bf9c6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:45.310601 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a581a-9aee-44ca-8ddc-21c63bf9c6a7 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:45.310877 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a581a-9aee-44ca-8ddc-21c63bf9c6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:45.311599 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a581a-9aee-44ca-8ddc-21c63bf9c6a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:45.314522 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 288/572] 10.222.0.20 () {56 vars in 1137 bytes} [Sat Jun 18 04:05:45 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:45.315731 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da674d9-6916-4370-a159-b6c416cc7399 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:45.315997 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da674d9-6916-4370-a159-b6c416cc7399 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:45.316264 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da674d9-6916-4370-a159-b6c416cc7399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:45.323301 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3a581a-9aee-44ca-8ddc-21c63bf9c6a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:45.325527 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3a581a-9aee-44ca-8ddc-21c63bf9c6a7 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:45.333744 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-3da674d9-6916-4370-a159-b6c416cc7399 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:45.334937 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3da674d9-6916-4370-a159-b6c416cc7399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:45.343415 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-9f3a581a-9aee-44ca-8ddc-21c63bf9c6a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:45.343415 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:45.343415 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:45.343415 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:45.343415 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:45.343415 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:45.343415 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:45.343415 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:45.343415 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:45.343415 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:45.343415 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:45.343415 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:45.343415 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:05:45.343415 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:05:45.343415 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:05:45.344283 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:05:45.344283 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:45.344283 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:45.344283 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:45.344283 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:45.344283 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:45.344283 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:45.344283 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:45.344283 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:45.344283 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:45.344283 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:45.344283 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:45.344283 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:45.344283 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:45.344283 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:45.344283 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:45.344283 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:45.345195 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:05:45.345195 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:05:45.345195 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:45.345195 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:05:45.345195 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 285/573] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:05:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:45.345582 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3a581a-9aee-44ca-8ddc-21c63bf9c6a7 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:45.348306 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:45.362468 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:45.406779 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 289/574] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:05:45.407633 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da674d9-6916-4370-a159-b6c416cc7399 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:45.458395 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3a581a-9aee-44ca-8ddc-21c63bf9c6a7 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:45.492913 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935ec91-18f7-42e0-818c-14929d5647ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:45.493573 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935ec91-18f7-42e0-818c-14929d5647ba None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:45.493861 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935ec91-18f7-42e0-818c-14929d5647ba None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:45.494133 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935ec91-18f7-42e0-818c-14929d5647ba None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:45.494851 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a935ec91-18f7-42e0-818c-14929d5647ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:45.495149 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a935ec91-18f7-42e0-818c-14929d5647ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:45.496532 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a935ec91-18f7-42e0-818c-14929d5647ba None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:45.504072 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da674d9-6916-4370-a159-b6c416cc7399 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:45.508345 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 286/575] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:05:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:45.509005 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935ec91-18f7-42e0-818c-14929d5647ba None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:45.540391 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a9f989-2a22-401a-8c13-cd87f4c93807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:45.541271 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9f989-2a22-401a-8c13-cd87f4c93807 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:45.541271 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9f989-2a22-401a-8c13-cd87f4c93807 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:45.541567 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9f989-2a22-401a-8c13-cd87f4c93807 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:45.542405 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a9f989-2a22-401a-8c13-cd87f4c93807 None admin] RBAC: Adding query filter params (role.id=f055a7ed241c4492a4f92494099bab54, scope.project.id=9649aee8c5554102bc4193003300a3ad, user.id=fbfd82b05777466b97d46d376d4e11eb) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:45.542710 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a9f989-2a22-401a-8c13-cd87f4c93807 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:45.544161 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a9f989-2a22-401a-8c13-cd87f4c93807 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:45.549654 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 290/576] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Jun 18 04:05:45 2022] GET /identity/v3/role_assignments?user.id=fbfd82b05777466b97d46d376d4e11eb&scope.project.id=9649aee8c5554102bc4193003300a3ad&role.id=f055a7ed241c4492a4f92494099bab54 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:45.550419 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a9f989-2a22-401a-8c13-cd87f4c93807 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:45.577720 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:45.591327 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:45.637222 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935ec91-18f7-42e0-818c-14929d5647ba None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:45.665529 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a9f989-2a22-401a-8c13-cd87f4c93807 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:45.673937 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a9b42-1daf-44e9-8649-f6718fa0ffcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:45.674746 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a9b42-1daf-44e9-8649-f6718fa0ffcf None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:45.675016 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a9b42-1daf-44e9-8649-f6718fa0ffcf None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:45.675284 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a9b42-1daf-44e9-8649-f6718fa0ffcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:45.688005 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a9b42-1daf-44e9-8649-f6718fa0ffcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:45.690201 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a9b42-1daf-44e9-8649-f6718fa0ffcf None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:45.705397 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7815350-11d0-4fd3-9795-4af8abccbc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:45.706069 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7815350-11d0-4fd3-9795-4af8abccbc04 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:45.706344 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7815350-11d0-4fd3-9795-4af8abccbc04 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:45.706616 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7815350-11d0-4fd3-9795-4af8abccbc04 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:45.707346 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7815350-11d0-4fd3-9795-4af8abccbc04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:45.707645 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7815350-11d0-4fd3-9795-4af8abccbc04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:45.709060 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7815350-11d0-4fd3-9795-4af8abccbc04 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:45.709740 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-bf8a9b42-1daf-44e9-8649-f6718fa0ffcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:45.709740 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:45.709740 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:45.709740 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:45.709740 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:45.709740 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:45.709740 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:45.709740 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:45.709740 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:45.709740 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:45.709740 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:45.709740 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:45.709740 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:05:45.709740 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:05:45.709740 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:05:45.710568 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:05:45.710568 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:45.710568 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:45.710568 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:45.710568 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:45.710568 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:45.710568 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:45.710568 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:45.710568 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:45.710568 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:45.710568 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:45.710568 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:45.710568 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:45.710568 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:45.710568 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:45.710568 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:45.710568 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:45.711430 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:05:45.711430 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:05:45.711430 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:45.711430 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:05:45.711430 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 287/577] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:05:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:45.711761 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a9b42-1daf-44e9-8649-f6718fa0ffcf None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:45.733003 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 291/578] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:05:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:45.733003 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7815350-11d0-4fd3-9795-4af8abccbc04 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:45.821276 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:45.826600 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a9b42-1daf-44e9-8649-f6718fa0ffcf None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:45.838701 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7815350-11d0-4fd3-9795-4af8abccbc04 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:45.842870 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:45.865971 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ba1cc-e853-450e-ab02-3904d465dfdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:45.866770 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ba1cc-e853-450e-ab02-3904d465dfdf None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:45.867046 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ba1cc-e853-450e-ab02-3904d465dfdf None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:45.867311 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ba1cc-e853-450e-ab02-3904d465dfdf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:45.872976 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de27e57-20fd-4b15-a6f8-fdeb87c405c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:45.873770 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de27e57-20fd-4b15-a6f8-fdeb87c405c8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:45.874043 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de27e57-20fd-4b15-a6f8-fdeb87c405c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:45.874306 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de27e57-20fd-4b15-a6f8-fdeb87c405c8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:45.879186 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1ba1cc-e853-450e-ab02-3904d465dfdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:05:45.881953 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de27e57-20fd-4b15-a6f8-fdeb87c405c8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:45.883398 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de27e57-20fd-4b15-a6f8-fdeb87c405c8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:45.887372 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-0c1ba1cc-e853-450e-ab02-3904d465dfdf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 18 04:05:45.887372 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:45.887372 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:45.887372 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:45.887372 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:45.887372 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:45.887372 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:45.887372 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:45.887372 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:45.887372 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:45.887372 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:45.887372 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:45.887372 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:05:45.887372 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:05:45.887372 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:05:45.887372 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:05:45.888267 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:05:45.888267 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:05:45.888267 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:05:45.888267 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:05:45.888267 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:45.888267 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:45.888267 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:45.888267 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:45.888267 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:45.888267 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:45.888267 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:45.888267 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:45.888267 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:45.888267 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:45.888267 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:45.888267 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:45.889151 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:45.889151 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:45.889151 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:45.889151 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:45.889151 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:05:45.889151 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:05:45.889151 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:05:45.889151 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:05:45.889151 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:05:45.889151 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:05:45.889151 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 18 04:05:45.889151 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:05:45.893605 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 288/579] 10.222.0.20 () {56 vars in 1102 bytes} [Sat Jun 18 04:05:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:45.894278 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ba1cc-e853-450e-ab02-3904d465dfdf None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:45.898710 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-9de27e57-20fd-4b15-a6f8-fdeb87c405c8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 18 04:05:45.898710 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:45.898710 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:45.898710 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:45.898710 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:45.898710 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:45.898710 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:45.898710 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:45.898710 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:45.898710 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:45.898710 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:45.898710 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:45.898710 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 04:05:45.898710 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 04:05:45.898710 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 04:05:45.898710 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 04:05:45.899664 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:45.899664 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:45.899664 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 04:05:45.899664 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 04:05:45.899664 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 04:05:45.899664 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 04:05:45.899664 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:45.899664 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:45.899664 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:45.899664 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:45.899664 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:45.899664 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:45.899664 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:45.899664 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:45.899664 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:45.899664 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:45.899664 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:45.899664 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:45.900703 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:45.900703 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:45.900703 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 04:05:45.900703 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 04:05:45.900703 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 04:05:45.900703 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 04:05:45.900703 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 04:05:45.900703 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 04:05:45.900703 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 18 04:05:45.900703 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:45.900703 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 292/580] 10.222.0.20 () {56 vars in 1093 bytes} [Sat Jun 18 04:05:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:45.901278 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de27e57-20fd-4b15-a6f8-fdeb87c405c8 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:46.010316 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ba1cc-e853-450e-ab02-3904d465dfdf None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:46.016814 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de27e57-20fd-4b15-a6f8-fdeb87c405c8 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:46.046144 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3804518-0b3b-4867-9ee8-ceb533a33b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:46.046809 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3804518-0b3b-4867-9ee8-ceb533a33b85 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:46.047084 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3804518-0b3b-4867-9ee8-ceb533a33b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:46.047340 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3804518-0b3b-4867-9ee8-ceb533a33b85 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:46.048066 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3804518-0b3b-4867-9ee8-ceb533a33b85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:46.048485 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3804518-0b3b-4867-9ee8-ceb533a33b85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:46.049756 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3804518-0b3b-4867-9ee8-ceb533a33b85 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:46.056154 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff1637e-4c45-4339-8955-542906b34dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:46.057589 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1637e-4c45-4339-8955-542906b34dbe None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:46.057868 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1637e-4c45-4339-8955-542906b34dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:46.058147 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1637e-4c45-4339-8955-542906b34dbe None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:46.061710 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 289/581] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:05:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:46.062488 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3804518-0b3b-4867-9ee8-ceb533a33b85 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:46.071783 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff1637e-4c45-4339-8955-542906b34dbe None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:46.073258 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff1637e-4c45-4339-8955-542906b34dbe None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:46.087550 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-bff1637e-4c45-4339-8955-542906b34dbe None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 18 04:05:46.087550 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:46.087550 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:46.087550 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:46.087550 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:46.087550 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:46.087550 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:46.087550 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:46.087550 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:46.087550 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:46.087550 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:46.087550 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:46.087550 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 04:05:46.087550 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 04:05:46.087550 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 04:05:46.087550 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 04:05:46.088490 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:46.088490 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:46.088490 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 04:05:46.088490 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 04:05:46.088490 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 04:05:46.088490 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 04:05:46.088490 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:46.088490 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:46.088490 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:46.088490 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:46.088490 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:46.088490 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:46.088490 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:46.088490 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:46.088490 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:46.088490 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:46.088490 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:46.088490 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:46.089427 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:46.089427 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:46.089427 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 04:05:46.089427 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 04:05:46.089427 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 04:05:46.089427 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 04:05:46.089427 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 04:05:46.089427 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 04:05:46.089427 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 18 04:05:46.089427 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:46.089427 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 293/582] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Jun 18 04:05:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:46.089991 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff1637e-4c45-4339-8955-542906b34dbe None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:46.095069 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:46.102307 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:46.172164 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3804518-0b3b-4867-9ee8-ceb533a33b85 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:46.199685 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff1637e-4c45-4339-8955-542906b34dbe None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:46.206457 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078e5db-d688-4f8b-9ef2-3314926b4035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:46.207126 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078e5db-d688-4f8b-9ef2-3314926b4035 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:46.207428 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078e5db-d688-4f8b-9ef2-3314926b4035 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:46.207666 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078e5db-d688-4f8b-9ef2-3314926b4035 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:46.208429 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5078e5db-d688-4f8b-9ef2-3314926b4035 None admin] RBAC: Adding query filter params (name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:46.208773 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5078e5db-d688-4f8b-9ef2-3314926b4035 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:46.210142 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5078e5db-d688-4f8b-9ef2-3314926b4035 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:46.222645 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 290/583] 10.222.0.20 () {56 vars in 1103 bytes} [Sat Jun 18 04:05:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:46.222645 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078e5db-d688-4f8b-9ef2-3314926b4035 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:46.237984 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e4ac6-ae7e-4dc9-93aa-0520557c7660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:46.238660 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e4ac6-ae7e-4dc9-93aa-0520557c7660 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:46.239005 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e4ac6-ae7e-4dc9-93aa-0520557c7660 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:46.239211 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e4ac6-ae7e-4dc9-93aa-0520557c7660 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:46.240048 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e4ac6-ae7e-4dc9-93aa-0520557c7660 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:46.240356 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e4ac6-ae7e-4dc9-93aa-0520557c7660 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:46.241839 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e4ac6-ae7e-4dc9-93aa-0520557c7660 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:46.263602 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 294/584] 10.222.0.20 () {56 vars in 1133 bytes} [Sat Jun 18 04:05:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:46.263602 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e4ac6-ae7e-4dc9-93aa-0520557c7660 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:46.322744 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:46.326127 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:46.333415 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078e5db-d688-4f8b-9ef2-3314926b4035 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:46.364618 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e4ac6-ae7e-4dc9-93aa-0520557c7660 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:46.368173 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51126312-bc5f-4794-a4a5-b06054ed372a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:46.369056 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51126312-bc5f-4794-a4a5-b06054ed372a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:46.369333 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51126312-bc5f-4794-a4a5-b06054ed372a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:46.369598 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51126312-bc5f-4794-a4a5-b06054ed372a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:46.376832 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51126312-bc5f-4794-a4a5-b06054ed372a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:46.378505 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51126312-bc5f-4794-a4a5-b06054ed372a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:46.393523 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-51126312-bc5f-4794-a4a5-b06054ed372a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 04:05:46.393523 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:46.393523 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:46.393523 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:46.393523 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:46.393523 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:46.393523 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:46.393523 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:46.393523 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:46.393523 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:46.393523 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:46.393523 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:46.393523 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 04:05:46.393523 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 04:05:46.393523 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 04:05:46.394379 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 04:05:46.394379 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:46.394379 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:46.394379 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:46.394379 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:46.394379 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:46.394379 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:46.394379 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:46.394379 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:46.394379 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:46.394379 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:46.394379 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:46.394379 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:46.394379 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:46.394379 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:46.394379 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:46.394379 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:46.395312 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 04:05:46.395312 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 04:05:46.395312 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 04:05:46.395312 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 04:05:46.395312 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 04:05:46.395312 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 04:05:46.395312 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 04:05:46.395312 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:05:46.395312 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 291/585] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Jun 18 04:05:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:46.395794 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51126312-bc5f-4794-a4a5-b06054ed372a None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:46.402491 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7371fb-f34b-4e24-adeb-2ed73c9b27fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:46.403168 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7371fb-f34b-4e24-adeb-2ed73c9b27fd None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:46.403440 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7371fb-f34b-4e24-adeb-2ed73c9b27fd None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:46.403716 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7371fb-f34b-4e24-adeb-2ed73c9b27fd None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:46.404540 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7371fb-f34b-4e24-adeb-2ed73c9b27fd None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:46.404874 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7371fb-f34b-4e24-adeb-2ed73c9b27fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:46.406293 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7371fb-f34b-4e24-adeb-2ed73c9b27fd None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:46.426442 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 295/586] 10.222.0.20 () {56 vars in 1137 bytes} [Sat Jun 18 04:05:46 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:46.427254 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7371fb-f34b-4e24-adeb-2ed73c9b27fd None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:46.511487 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51126312-bc5f-4794-a4a5-b06054ed372a None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:46.533758 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7371fb-f34b-4e24-adeb-2ed73c9b27fd None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:46.551447 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef576868-b94a-48d6-89f0-c4b9d941cac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:46.552458 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef576868-b94a-48d6-89f0-c4b9d941cac0 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:46.552926 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef576868-b94a-48d6-89f0-c4b9d941cac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:46.553338 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef576868-b94a-48d6-89f0-c4b9d941cac0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:46.554019 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:46.567127 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef576868-b94a-48d6-89f0-c4b9d941cac0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:46.568594 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef576868-b94a-48d6-89f0-c4b9d941cac0 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:46.568936 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1cfda6-36c8-4b8c-ba7a-43dee1917561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:46.569802 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1cfda6-36c8-4b8c-ba7a-43dee1917561 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:46.570142 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1cfda6-36c8-4b8c-ba7a-43dee1917561 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:46.570477 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1cfda6-36c8-4b8c-ba7a-43dee1917561 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:46.580643 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1cfda6-36c8-4b8c-ba7a-43dee1917561 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:46.582085 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1cfda6-36c8-4b8c-ba7a-43dee1917561 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:46.587857 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-ef576868-b94a-48d6-89f0-c4b9d941cac0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:46.587857 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:46.587857 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:46.587857 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:46.587857 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:46.587857 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:46.587857 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:46.587857 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:46.587857 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:46.587857 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:46.587857 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:46.587857 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:46.587857 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:05:46.587857 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:05:46.587857 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:05:46.588936 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:05:46.588936 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:46.588936 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:46.588936 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:46.588936 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:46.588936 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:46.588936 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:46.588936 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:46.588936 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:46.588936 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:46.588936 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:46.588936 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:46.588936 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:46.588936 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:46.588936 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:46.588936 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:46.588936 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:46.590007 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:05:46.590007 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:05:46.590007 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:46.590007 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:05:46.590640 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 292/587] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:05:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:46.595985 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef576868-b94a-48d6-89f0-c4b9d941cac0 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:46.602082 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-6d1cfda6-36c8-4b8c-ba7a-43dee1917561 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:46.602082 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:46.602082 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:46.602082 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:46.602082 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:46.602082 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:46.602082 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:46.602082 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:46.602082 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:46.602082 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:46.602082 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:46.602082 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:46.602082 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:05:46.602082 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:05:46.602082 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:05:46.603149 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:05:46.603149 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:46.603149 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:46.603149 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:46.603149 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:46.603149 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:46.603149 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:46.603149 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:46.603149 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:46.603149 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:46.603149 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:46.603149 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:46.603149 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:46.603149 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:46.603149 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:46.603149 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:46.603149 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:46.604982 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:05:46.604982 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:05:46.604982 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:46.604982 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:46.604982 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 296/588] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:05:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:46.605675 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1cfda6-36c8-4b8c-ba7a-43dee1917561 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:46.611553 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:46.707309 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef576868-b94a-48d6-89f0-c4b9d941cac0 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:46.713813 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1cfda6-36c8-4b8c-ba7a-43dee1917561 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:46.743080 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9308f6-1667-4c24-9ea0-23bb91012942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:46.743758 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9308f6-1667-4c24-9ea0-23bb91012942 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:46.744035 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9308f6-1667-4c24-9ea0-23bb91012942 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:46.744300 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9308f6-1667-4c24-9ea0-23bb91012942 None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:46.745120 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9308f6-1667-4c24-9ea0-23bb91012942 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:46.745449 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9308f6-1667-4c24-9ea0-23bb91012942 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:46.746836 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9308f6-1667-4c24-9ea0-23bb91012942 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:46.748229 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6c9f7-a767-407d-927b-c90c96b75064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:46.749085 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6c9f7-a767-407d-927b-c90c96b75064 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:46.749434 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6c9f7-a767-407d-927b-c90c96b75064 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:46.749679 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6c9f7-a767-407d-927b-c90c96b75064 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:46.759260 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 293/589] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Jun 18 04:05:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:46.760420 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9308f6-1667-4c24-9ea0-23bb91012942 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:46.765556 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb6c9f7-a767-407d-927b-c90c96b75064 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:46.767016 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb6c9f7-a767-407d-927b-c90c96b75064 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:46.785269 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-4eb6c9f7-a767-407d-927b-c90c96b75064 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:46.785269 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:46.785269 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:46.785269 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:46.785269 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:46.785269 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:46.785269 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:46.785269 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:46.785269 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:46.785269 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:46.785269 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:46.785269 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:46.785269 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:05:46.785269 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:05:46.785269 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:05:46.786217 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:05:46.786217 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:46.786217 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:46.786217 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:46.786217 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:46.786217 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:46.786217 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:46.786217 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:46.786217 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:46.786217 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:46.786217 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:46.786217 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:46.786217 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:46.786217 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:46.786217 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:46.786217 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:46.786217 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:46.787111 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:05:46.787111 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:05:46.787111 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:46.787111 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:46.787111 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 297/590] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:05:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:46.787375 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6c9f7-a767-407d-927b-c90c96b75064 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:46.813034 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:46.838039 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:46.874029 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9308f6-1667-4c24-9ea0-23bb91012942 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:46.890332 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6c9f7-a767-407d-927b-c90c96b75064 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:46.913297 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f805f-def1-4fcc-b707-0130f43d1d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:46.913963 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f805f-def1-4fcc-b707-0130f43d1d3d None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:46.914241 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f805f-def1-4fcc-b707-0130f43d1d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:46.914510 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f805f-def1-4fcc-b707-0130f43d1d3d None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:46.915240 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42f805f-def1-4fcc-b707-0130f43d1d3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:46.915549 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42f805f-def1-4fcc-b707-0130f43d1d3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:46.917028 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42f805f-def1-4fcc-b707-0130f43d1d3d None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:46.926000 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ada719-3c92-49be-951f-9813ba012222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:46.926857 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ada719-3c92-49be-951f-9813ba012222 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:46.927301 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ada719-3c92-49be-951f-9813ba012222 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:46.927757 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ada719-3c92-49be-951f-9813ba012222 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:46.928600 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 294/591] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:05:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:46.928843 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ada719-3c92-49be-951f-9813ba012222 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:46.929293 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ada719-3c92-49be-951f-9813ba012222 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:46.929393 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f805f-def1-4fcc-b707-0130f43d1d3d None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:46.931062 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ada719-3c92-49be-951f-9813ba012222 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:46.944947 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 298/592] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:05:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:46.946033 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ada719-3c92-49be-951f-9813ba012222 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:47.038629 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:47.046662 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f805f-def1-4fcc-b707-0130f43d1d3d None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:47.056069 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ada719-3c92-49be-951f-9813ba012222 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:47.075369 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:47.085641 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977d7b2-6398-4c82-9588-e901040a85bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:47.086606 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977d7b2-6398-4c82-9588-e901040a85bc None admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:47.086885 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977d7b2-6398-4c82-9588-e901040a85bc None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:47.087154 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977d7b2-6398-4c82-9588-e901040a85bc None admin] PATH_INFO: `/v3/projects/9649aee8c5554102bc4193003300a3ad/users/2a6f686b7cfa455d82559e69ee0a4d7f/roles/f055a7ed241c4492a4f92494099bab54` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:47.091838 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5640c7e-7b49-4799-ad27-93ab5d02f05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:47.092740 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5640c7e-7b49-4799-ad27-93ab5d02f05b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:47.093199 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5640c7e-7b49-4799-ad27-93ab5d02f05b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:47.093642 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5640c7e-7b49-4799-ad27-93ab5d02f05b None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:47.094556 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5640c7e-7b49-4799-ad27-93ab5d02f05b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:47.095043 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5640c7e-7b49-4799-ad27-93ab5d02f05b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:47.096605 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5640c7e-7b49-4799-ad27-93ab5d02f05b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:47.102245 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0977d7b2-6398-4c82-9588-e901040a85bc None admin] RBAC: Authorizing `identity:create_grant(project_id=9649aee8c5554102bc4193003300a3ad, user_id=2a6f686b7cfa455d82559e69ee0a4d7f, role_id=f055a7ed241c4492a4f92494099bab54)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:47.103728 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0977d7b2-6398-4c82-9588-e901040a85bc None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:47.109836 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 299/593] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:05:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:47.111006 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5640c7e-7b49-4799-ad27-93ab5d02f05b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:47.122040 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 295/594] 10.222.0.20 () {58 vars in 1439 bytes} [Sat Jun 18 04:05:46 2022] PUT /identity/v3/projects/9649aee8c5554102bc4193003300a3ad/users/2a6f686b7cfa455d82559e69ee0a4d7f/roles/f055a7ed241c4492a4f92494099bab54 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 04:05:47.123171 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977d7b2-6398-4c82-9588-e901040a85bc None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:47.237327 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5640c7e-7b49-4799-ad27-93ab5d02f05b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:47.266648 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977d7b2-6398-4c82-9588-e901040a85bc None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:47.276921 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94a9ec-37b4-4526-a71c-09e803f4452a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:47.277800 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94a9ec-37b4-4526-a71c-09e803f4452a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:47.278081 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94a9ec-37b4-4526-a71c-09e803f4452a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:47.278347 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94a9ec-37b4-4526-a71c-09e803f4452a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:47.288126 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e94a9ec-37b4-4526-a71c-09e803f4452a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:47.289291 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e94a9ec-37b4-4526-a71c-09e803f4452a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:47.305601 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-5e94a9ec-37b4-4526-a71c-09e803f4452a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 18 04:05:47.305601 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:47.305601 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:47.305601 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:47.305601 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:47.305601 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:47.305601 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:47.305601 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:47.305601 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:47.305601 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:47.305601 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:47.305601 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:47.305601 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 04:05:47.305601 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 04:05:47.305601 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 04:05:47.305601 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 04:05:47.306729 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:47.306729 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:47.306729 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 04:05:47.306729 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 04:05:47.306729 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 04:05:47.306729 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 04:05:47.306729 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:47.306729 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:47.306729 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:47.306729 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:47.306729 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:47.306729 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:47.306729 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:47.306729 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:47.306729 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:47.306729 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:47.306729 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:47.306729 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:47.307642 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:47.307642 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:47.307642 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 04:05:47.307642 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 04:05:47.307642 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 04:05:47.307642 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 04:05:47.307642 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 04:05:47.307642 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 04:05:47.307642 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 18 04:05:47.307642 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:47.311756 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 300/595] 10.222.0.20 () {56 vars in 1102 bytes} [Sat Jun 18 04:05:47 2022] GET /identity/v3/users/neutron => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:47.312887 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94a9ec-37b4-4526-a71c-09e803f4452a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:47.316007 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2590e37-cdcf-456c-a62d-2fa395f66eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:47.316851 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2590e37-cdcf-456c-a62d-2fa395f66eae None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:47.317130 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2590e37-cdcf-456c-a62d-2fa395f66eae None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:47.318343 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:47.318890 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2590e37-cdcf-456c-a62d-2fa395f66eae None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:47.327550 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2590e37-cdcf-456c-a62d-2fa395f66eae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:47.329388 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2590e37-cdcf-456c-a62d-2fa395f66eae None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:47.346607 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-a2590e37-cdcf-456c-a62d-2fa395f66eae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 04:05:47.346607 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:47.346607 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:47.346607 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:47.346607 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:47.346607 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:47.346607 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:47.346607 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:47.346607 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:47.346607 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:47.346607 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:47.346607 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:47.346607 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 04:05:47.346607 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 04:05:47.346607 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 04:05:47.347687 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 04:05:47.347687 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:47.347687 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:47.347687 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:47.347687 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:47.347687 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:47.347687 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:47.347687 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:47.347687 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:47.347687 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:47.347687 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:47.347687 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:47.347687 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:47.347687 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:47.347687 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:47.347687 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:47.347687 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:47.348614 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 04:05:47.348614 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 04:05:47.348614 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 04:05:47.348614 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 04:05:47.348614 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 04:05:47.348614 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 04:05:47.348614 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 04:05:47.348614 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:05:47.348614 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 296/596] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Jun 18 04:05:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:47.349118 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2590e37-cdcf-456c-a62d-2fa395f66eae None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:47.393068 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:47.446130 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94a9ec-37b4-4526-a71c-09e803f4452a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:47.458079 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2590e37-cdcf-456c-a62d-2fa395f66eae None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:47.494228 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc80c0d5-906d-45a6-95cd-e57f1ab19f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:47.495040 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc80c0d5-906d-45a6-95cd-e57f1ab19f3b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:47.495358 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc80c0d5-906d-45a6-95cd-e57f1ab19f3b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:47.495629 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc80c0d5-906d-45a6-95cd-e57f1ab19f3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:47.503977 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74de8afc-fea0-40a9-8959-01cac635a242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:47.504670 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de8afc-fea0-40a9-8959-01cac635a242 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:47.504946 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de8afc-fea0-40a9-8959-01cac635a242 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:47.505213 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de8afc-fea0-40a9-8959-01cac635a242 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:47.506147 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74de8afc-fea0-40a9-8959-01cac635a242 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:47.506452 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74de8afc-fea0-40a9-8959-01cac635a242 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:47.506830 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc80c0d5-906d-45a6-95cd-e57f1ab19f3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:47.507896 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74de8afc-fea0-40a9-8959-01cac635a242 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:47.508724 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc80c0d5-906d-45a6-95cd-e57f1ab19f3b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:47.527026 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-fc80c0d5-906d-45a6-95cd-e57f1ab19f3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 04:05:47.527026 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:47.527026 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:47.527026 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:47.527026 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:47.527026 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:47.527026 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:47.527026 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:47.527026 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:47.527026 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:47.527026 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:47.527026 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:47.527026 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 04:05:47.527026 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 04:05:47.527026 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 04:05:47.527955 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 04:05:47.527955 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:47.527955 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:47.527955 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:47.527955 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:47.527955 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:47.527955 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:47.527955 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:47.527955 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:47.527955 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:47.527955 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:47.527955 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:47.527955 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:47.527955 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:47.527955 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:47.527955 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:47.527955 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:47.529316 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 04:05:47.529316 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 04:05:47.529316 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 04:05:47.529316 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 04:05:47.529316 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 04:05:47.529316 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 04:05:47.529316 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 04:05:47.529316 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:47.531414 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 301/598] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Jun 18 04:05:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:47.531535 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 297/598] 10.222.0.20 () {56 vars in 1139 bytes} [Sat Jun 18 04:05:47 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:47.532514 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74de8afc-fea0-40a9-8959-01cac635a242 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:47.534105 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc80c0d5-906d-45a6-95cd-e57f1ab19f3b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:47.614998 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:47.643281 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:47.649768 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74de8afc-fea0-40a9-8959-01cac635a242 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:47.657071 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc80c0d5-906d-45a6-95cd-e57f1ab19f3b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:47.683755 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf84f96-665a-4f6e-9e7a-28f71bcd2839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:47.684413 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf84f96-665a-4f6e-9e7a-28f71bcd2839 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:47.684786 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf84f96-665a-4f6e-9e7a-28f71bcd2839 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:47.685105 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf84f96-665a-4f6e-9e7a-28f71bcd2839 None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:47.685881 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf84f96-665a-4f6e-9e7a-28f71bcd2839 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:47.686186 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf84f96-665a-4f6e-9e7a-28f71bcd2839 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:47.687608 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf84f96-665a-4f6e-9e7a-28f71bcd2839 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:47.693997 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2f4bd1-b229-42ac-8879-47f357cf1aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:47.694803 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2f4bd1-b229-42ac-8879-47f357cf1aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:47.695080 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2f4bd1-b229-42ac-8879-47f357cf1aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:47.695349 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2f4bd1-b229-42ac-8879-47f357cf1aa2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:47.699364 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 298/599] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Jun 18 04:05:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:47.700162 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf84f96-665a-4f6e-9e7a-28f71bcd2839 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:47.714580 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2f4bd1-b229-42ac-8879-47f357cf1aa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:47.716061 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2f4bd1-b229-42ac-8879-47f357cf1aa2 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:47.735405 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-2b2f4bd1-b229-42ac-8879-47f357cf1aa2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:47.735405 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:47.735405 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:47.735405 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:47.735405 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:47.735405 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:47.735405 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:47.735405 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:47.735405 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:47.735405 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:47.735405 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:47.735405 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:47.735405 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:05:47.735405 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:05:47.735405 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:05:47.736310 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:05:47.736310 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:47.736310 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:47.736310 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:47.736310 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:47.736310 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:47.736310 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:47.736310 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:47.736310 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:47.736310 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:47.736310 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:47.736310 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:47.736310 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:47.736310 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:47.736310 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:47.736310 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:47.736310 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:47.737527 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:05:47.737527 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:05:47.737527 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:47.737527 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:47.737527 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 302/600] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:05:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 04:05:47.738169 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781909c-bc8e-4cb7-91dc-671bc7554324 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:47.738447 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781909c-bc8e-4cb7-91dc-671bc7554324 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:47.738718 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781909c-bc8e-4cb7-91dc-671bc7554324 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:47.744497 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 303/601] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:05:47.744497 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d781909c-bc8e-4cb7-91dc-671bc7554324 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:47.813955 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf84f96-665a-4f6e-9e7a-28f71bcd2839 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:47.850077 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d781909c-bc8e-4cb7-91dc-671bc7554324 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:47.851417 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a11a8e1-a226-4c5f-9e05-5db03bc46004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:47.852096 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11a8e1-a226-4c5f-9e05-5db03bc46004 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:47.852371 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11a8e1-a226-4c5f-9e05-5db03bc46004 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:47.852667 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11a8e1-a226-4c5f-9e05-5db03bc46004 None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:47.853849 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a11a8e1-a226-4c5f-9e05-5db03bc46004 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:47.853849 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a11a8e1-a226-4c5f-9e05-5db03bc46004 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:47.855227 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a11a8e1-a226-4c5f-9e05-5db03bc46004 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:47.868165 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:47.868422 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 299/602] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Jun 18 04:05:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:47.869326 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a11a8e1-a226-4c5f-9e05-5db03bc46004 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:47.887975 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:47.888665 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c168208-896c-4f21-935e-5b30a9595966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:47.889568 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c168208-896c-4f21-935e-5b30a9595966 None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:47.889846 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c168208-896c-4f21-935e-5b30a9595966 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:47.890117 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c168208-896c-4f21-935e-5b30a9595966 None admin] PATH_INFO: `/v3/projects/9649aee8c5554102bc4193003300a3ad/users/c129f3de2bb2431593fac649fd4975b3/roles/f055a7ed241c4492a4f92494099bab54` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:47.905943 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c168208-896c-4f21-935e-5b30a9595966 None admin] RBAC: Authorizing `identity:create_grant(project_id=9649aee8c5554102bc4193003300a3ad, user_id=c129f3de2bb2431593fac649fd4975b3, role_id=f055a7ed241c4492a4f92494099bab54)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:47.908509 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c168208-896c-4f21-935e-5b30a9595966 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:47.921808 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 304/603] 10.222.0.20 () {58 vars in 1439 bytes} [Sat Jun 18 04:05:47 2022] PUT /identity/v3/projects/9649aee8c5554102bc4193003300a3ad/users/c129f3de2bb2431593fac649fd4975b3/roles/f055a7ed241c4492a4f92494099bab54 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 04:05:47.923266 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da98b6e-6fa5-4dae-b727-5a9c73b554be None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:47.923552 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da98b6e-6fa5-4dae-b727-5a9c73b554be None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:47.923822 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da98b6e-6fa5-4dae-b727-5a9c73b554be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:47.949764 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-4da98b6e-6fa5-4dae-b727-5a9c73b554be None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:47.950996 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4da98b6e-6fa5-4dae-b727-5a9c73b554be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:48.005926 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a11a8e1-a226-4c5f-9e05-5db03bc46004 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:48.041321 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 305/604] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:05:48.042210 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da98b6e-6fa5-4dae-b727-5a9c73b554be None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:48.046614 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068eaf3-fd5b-4ab5-9349-399b77a4d470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:48.047500 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068eaf3-fd5b-4ab5-9349-399b77a4d470 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:48.047951 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068eaf3-fd5b-4ab5-9349-399b77a4d470 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:48.048363 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068eaf3-fd5b-4ab5-9349-399b77a4d470 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:48.049272 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7068eaf3-fd5b-4ab5-9349-399b77a4d470 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:48.049761 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7068eaf3-fd5b-4ab5-9349-399b77a4d470 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:48.051414 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7068eaf3-fd5b-4ab5-9349-399b77a4d470 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:48.065046 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 300/605] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:05:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:48.074189 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068eaf3-fd5b-4ab5-9349-399b77a4d470 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:48.167114 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:48.172443 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:48.177377 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da98b6e-6fa5-4dae-b727-5a9c73b554be None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:48.195289 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068eaf3-fd5b-4ab5-9349-399b77a4d470 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:48.221873 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444da6dd-3e08-4ccd-9943-7d70ce215ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:48.223056 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444da6dd-3e08-4ccd-9943-7d70ce215ecd None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:48.223334 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444da6dd-3e08-4ccd-9943-7d70ce215ecd None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:48.223839 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444da6dd-3e08-4ccd-9943-7d70ce215ecd None admin] PATH_INFO: `/v3/projects/9649aee8c5554102bc4193003300a3ad/users/d0e9cb2b54724d4f9f71b7b1000cf72c/roles/f055a7ed241c4492a4f92494099bab54` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:48.232604 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f4cf6-b32a-4bdb-9dc3-3dc873539c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:48.233640 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f4cf6-b32a-4bdb-9dc3-3dc873539c85 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:48.234065 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f4cf6-b32a-4bdb-9dc3-3dc873539c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:48.234810 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f4cf6-b32a-4bdb-9dc3-3dc873539c85 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:48.240637 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444da6dd-3e08-4ccd-9943-7d70ce215ecd None admin] RBAC: Authorizing `identity:create_grant(project_id=9649aee8c5554102bc4193003300a3ad, user_id=d0e9cb2b54724d4f9f71b7b1000cf72c, role_id=f055a7ed241c4492a4f92494099bab54)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:48.242395 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f4cf6-b32a-4bdb-9dc3-3dc873539c85 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:48.242515 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444da6dd-3e08-4ccd-9943-7d70ce215ecd None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:48.244047 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f4cf6-b32a-4bdb-9dc3-3dc873539c85 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:48.263631 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 306/606] 10.222.0.20 () {58 vars in 1439 bytes} [Sat Jun 18 04:05:48 2022] PUT /identity/v3/projects/9649aee8c5554102bc4193003300a3ad/users/d0e9cb2b54724d4f9f71b7b1000cf72c/roles/f055a7ed241c4492a4f92494099bab54 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 04:05:48.264829 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444da6dd-3e08-4ccd-9943-7d70ce215ecd None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:48.269129 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-ef1f4cf6-b32a-4bdb-9dc3-3dc873539c85 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 04:05:48.269129 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:48.269129 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:48.269129 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:48.269129 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:48.269129 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:48.269129 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:48.269129 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:48.269129 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:48.269129 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:48.269129 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:48.269129 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:48.269129 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 04:05:48.269129 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 04:05:48.269129 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 04:05:48.270216 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 04:05:48.270216 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:48.270216 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:48.270216 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:48.270216 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:48.270216 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:48.270216 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:48.270216 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:48.270216 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:48.270216 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:48.270216 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:48.270216 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:48.270216 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:48.270216 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:48.270216 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:48.270216 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:48.270216 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:48.271331 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 04:05:48.271331 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 04:05:48.271331 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 04:05:48.271331 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 04:05:48.271331 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 04:05:48.271331 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 04:05:48.271331 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 04:05:48.271331 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:05:48.282959 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 301/607] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Jun 18 04:05:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:48.290004 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f4cf6-b32a-4bdb-9dc3-3dc873539c85 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:48.461018 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444da6dd-3e08-4ccd-9943-7d70ce215ecd None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:48.479758 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f4cf6-b32a-4bdb-9dc3-3dc873539c85 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:48.498826 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a6a6f-8888-453d-a27a-b70e952cc53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:48.500712 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a6a6f-8888-453d-a27a-b70e952cc53b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:48.501301 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a6a6f-8888-453d-a27a-b70e952cc53b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:48.501857 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a6a6f-8888-453d-a27a-b70e952cc53b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:48.523633 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a6a6f-8888-453d-a27a-b70e952cc53b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:05:48.532500 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-239a6a6f-8888-453d-a27a-b70e952cc53b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 18 04:05:48.532500 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:48.532500 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:48.532500 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:48.532500 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:48.532500 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:48.532500 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:48.532500 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:48.532500 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:48.532500 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:48.532500 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:48.532500 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:48.532500 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:05:48.532500 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:05:48.532500 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:05:48.532500 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:05:48.533661 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:05:48.533661 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:05:48.533661 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:05:48.533661 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:05:48.533661 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:48.533661 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:48.533661 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:48.533661 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:48.533661 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:48.533661 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:48.533661 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:48.533661 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:48.533661 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:48.533661 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:48.533661 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:48.533661 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:48.534693 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:48.534693 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:48.534693 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:48.534693 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:48.534693 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:05:48.534693 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:05:48.534693 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:05:48.534693 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:05:48.534693 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:05:48.534693 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:05:48.534693 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 18 04:05:48.534693 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:48.537508 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 307/608] 10.222.0.20 () {56 vars in 1102 bytes} [Sat Jun 18 04:05:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:48.538880 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0977ff-ad11-48ce-a05e-20e4a8baa256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:48.539640 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0977ff-ad11-48ce-a05e-20e4a8baa256 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:48.540016 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0977ff-ad11-48ce-a05e-20e4a8baa256 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:48.540374 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0977ff-ad11-48ce-a05e-20e4a8baa256 None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:48.541407 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0977ff-ad11-48ce-a05e-20e4a8baa256 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:48.541883 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0977ff-ad11-48ce-a05e-20e4a8baa256 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:48.543574 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0977ff-ad11-48ce-a05e-20e4a8baa256 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:48.546381 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a6a6f-8888-453d-a27a-b70e952cc53b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:48.547806 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:48.564160 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:48.566954 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 302/609] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Jun 18 04:05:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:05:48.574225 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0977ff-ad11-48ce-a05e-20e4a8baa256 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:48.702440 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a6a6f-8888-453d-a27a-b70e952cc53b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:48.745259 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0977ff-ad11-48ce-a05e-20e4a8baa256 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:48.765338 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f71a8-449f-42ee-9c14-a7eaa3d13702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:48.766042 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f71a8-449f-42ee-9c14-a7eaa3d13702 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:48.766316 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f71a8-449f-42ee-9c14-a7eaa3d13702 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:48.767732 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f71a8-449f-42ee-9c14-a7eaa3d13702 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:48.768494 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88f71a8-449f-42ee-9c14-a7eaa3d13702 None admin] RBAC: Adding query filter params (name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:48.768904 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88f71a8-449f-42ee-9c14-a7eaa3d13702 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:48.770279 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88f71a8-449f-42ee-9c14-a7eaa3d13702 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:48.784049 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 308/610] 10.222.0.20 () {56 vars in 1103 bytes} [Sat Jun 18 04:05:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:48.789172 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f71a8-449f-42ee-9c14-a7eaa3d13702 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:48.798036 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f156e-f9f0-4e87-a3cf-34c57a828238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:48.798938 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f156e-f9f0-4e87-a3cf-34c57a828238 None admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:48.799212 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f156e-f9f0-4e87-a3cf-34c57a828238 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:48.799486 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f156e-f9f0-4e87-a3cf-34c57a828238 None admin] PATH_INFO: `/v3/projects/9649aee8c5554102bc4193003300a3ad/users/0798570229d943319caac5787bdcb9df/roles/f055a7ed241c4492a4f92494099bab54` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:48.830000 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212f156e-f9f0-4e87-a3cf-34c57a828238 None admin] RBAC: Authorizing `identity:create_grant(project_id=9649aee8c5554102bc4193003300a3ad, user_id=0798570229d943319caac5787bdcb9df, role_id=f055a7ed241c4492a4f92494099bab54)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:48.831455 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212f156e-f9f0-4e87-a3cf-34c57a828238 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:48.855478 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 303/611] 10.222.0.20 () {58 vars in 1439 bytes} [Sat Jun 18 04:05:48 2022] PUT /identity/v3/projects/9649aee8c5554102bc4193003300a3ad/users/0798570229d943319caac5787bdcb9df/roles/f055a7ed241c4492a4f92494099bab54 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 04:05:48.908996 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:48.953510 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f71a8-449f-42ee-9c14-a7eaa3d13702 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:49.007001 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b43e9-f871-4057-8ff2-4bad5687497a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:49.007739 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b43e9-f871-4057-8ff2-4bad5687497a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:49.008014 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b43e9-f871-4057-8ff2-4bad5687497a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:49.008287 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b43e9-f871-4057-8ff2-4bad5687497a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:49.020828 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176b43e9-f871-4057-8ff2-4bad5687497a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:49.022316 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176b43e9-f871-4057-8ff2-4bad5687497a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:49.040292 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-176b43e9-f871-4057-8ff2-4bad5687497a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:49.040292 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:49.040292 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:49.040292 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:49.040292 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:49.040292 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:49.040292 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:49.040292 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:49.040292 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:49.040292 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:49.040292 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:49.040292 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:49.040292 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:05:49.040292 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:05:49.040292 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:05:49.041357 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:05:49.041357 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:49.041357 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:49.041357 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:49.041357 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:49.041357 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:49.041357 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:49.041357 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:49.041357 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:49.041357 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:49.041357 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:49.041357 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:49.041357 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:49.041357 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:49.041357 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:49.041357 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:49.041357 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:49.042246 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:05:49.042246 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:05:49.042246 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:49.042246 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:49.042246 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 309/612] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:05:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 04:05:49.049958 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f156e-f9f0-4e87-a3cf-34c57a828238 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:49.119004 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:49.183082 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f156e-f9f0-4e87-a3cf-34c57a828238 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:49.220431 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca10f7-1324-49e6-8a5d-cb3b873ef3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:49.221503 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca10f7-1324-49e6-8a5d-cb3b873ef3b3 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:49.221979 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca10f7-1324-49e6-8a5d-cb3b873ef3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:49.222478 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca10f7-1324-49e6-8a5d-cb3b873ef3b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:49.223406 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca10f7-1324-49e6-8a5d-cb3b873ef3b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:49.223903 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca10f7-1324-49e6-8a5d-cb3b873ef3b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:49.225508 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca10f7-1324-49e6-8a5d-cb3b873ef3b3 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:49.241832 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 304/613] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:05:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:49.247074 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b43e9-f871-4057-8ff2-4bad5687497a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:49.365451 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b43e9-f871-4057-8ff2-4bad5687497a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:49.385919 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:49.400609 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0815309b-990e-496a-8aef-80912788c5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:49.401423 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815309b-990e-496a-8aef-80912788c5a2 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:49.401699 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815309b-990e-496a-8aef-80912788c5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:49.401972 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815309b-990e-496a-8aef-80912788c5a2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:49.409986 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0815309b-990e-496a-8aef-80912788c5a2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:49.411430 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0815309b-990e-496a-8aef-80912788c5a2 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:49.425724 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-0815309b-990e-496a-8aef-80912788c5a2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 18 04:05:49.425724 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:49.425724 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:49.425724 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:49.425724 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:49.425724 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:49.425724 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:49.425724 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:49.425724 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:49.425724 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:49.425724 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:49.425724 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:49.425724 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 04:05:49.425724 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 04:05:49.425724 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 04:05:49.425724 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 04:05:49.426673 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:49.426673 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:49.426673 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 04:05:49.426673 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 04:05:49.426673 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 04:05:49.426673 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 04:05:49.426673 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:49.426673 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:49.426673 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:49.426673 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:49.426673 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:49.426673 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:49.426673 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:49.426673 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:49.426673 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:49.426673 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:49.426673 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:49.426673 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:49.427613 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:49.427613 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:49.427613 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 04:05:49.427613 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 04:05:49.427613 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 04:05:49.427613 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 04:05:49.427613 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 04:05:49.427613 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 04:05:49.427613 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 18 04:05:49.427613 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:49.427613 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 310/614] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Jun 18 04:05:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:49.433072 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca10f7-1324-49e6-8a5d-cb3b873ef3b3 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:49.492630 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581ab8c-a5a0-4cf9-a736-f099d5b74b07 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:49.492970 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581ab8c-a5a0-4cf9-a736-f099d5b74b07 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:49.493178 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581ab8c-a5a0-4cf9-a736-f099d5b74b07 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:49.494885 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 311/615] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:05:49.500301 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77a994-c13b-40ab-9dd0-c0970d6d9fd7 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:49.500602 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77a994-c13b-40ab-9dd0-c0970d6d9fd7 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:49.500883 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77a994-c13b-40ab-9dd0-c0970d6d9fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:49.519044 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-bf77a994-c13b-40ab-9dd0-c0970d6d9fd7 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:49.520339 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-bf77a994-c13b-40ab-9dd0-c0970d6d9fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:49.558217 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca10f7-1324-49e6-8a5d-cb3b873ef3b3 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:49.566720 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:49.597580 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fead94-da1e-4f57-aa1d-333a52f405ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:49.597869 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 312/616] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:05:49.598258 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fead94-da1e-4f57-aa1d-333a52f405ca None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:49.598541 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fead94-da1e-4f57-aa1d-333a52f405ca None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:49.598814 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fead94-da1e-4f57-aa1d-333a52f405ca None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:49.599742 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fead94-da1e-4f57-aa1d-333a52f405ca None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:49.600064 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fead94-da1e-4f57-aa1d-333a52f405ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:49.608621 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fead94-da1e-4f57-aa1d-333a52f405ca None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:49.621057 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 305/617] 10.222.0.20 () {56 vars in 1135 bytes} [Sat Jun 18 04:05:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:49.626484 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf77a994-c13b-40ab-9dd0-c0970d6d9fd7 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:49.630139 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fead94-da1e-4f57-aa1d-333a52f405ca None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:49.735524 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf77a994-c13b-40ab-9dd0-c0970d6d9fd7 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:49.740966 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fead94-da1e-4f57-aa1d-333a52f405ca None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:49.747685 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:49.773391 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a30930b-7a3d-4c11-a5fe-c10ba971041b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:49.774387 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30930b-7a3d-4c11-a5fe-c10ba971041b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:49.774765 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30930b-7a3d-4c11-a5fe-c10ba971041b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:49.775167 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30930b-7a3d-4c11-a5fe-c10ba971041b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:49.778376 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19fb3d-5c64-4ecb-adc9-d075bfbcdc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:49.779353 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19fb3d-5c64-4ecb-adc9-d075bfbcdc76 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:49.779779 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19fb3d-5c64-4ecb-adc9-d075bfbcdc76 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:49.780238 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19fb3d-5c64-4ecb-adc9-d075bfbcdc76 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:49.786605 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a30930b-7a3d-4c11-a5fe-c10ba971041b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:49.788306 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a30930b-7a3d-4c11-a5fe-c10ba971041b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:49.791725 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd19fb3d-5c64-4ecb-adc9-d075bfbcdc76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:05:49.804794 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-cd19fb3d-5c64-4ecb-adc9-d075bfbcdc76 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 18 04:05:49.804794 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:49.804794 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:49.804794 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:49.804794 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:49.804794 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:49.804794 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:49.804794 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:49.804794 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:49.804794 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:49.804794 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:49.804794 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:49.804794 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:05:49.804794 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:05:49.804794 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:05:49.804794 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:05:49.805959 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:05:49.805959 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:05:49.805959 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:05:49.805959 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:05:49.805959 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:49.805959 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:49.805959 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:49.805959 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:49.805959 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:49.805959 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:49.805959 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:49.805959 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:49.805959 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:49.805959 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:49.805959 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:49.805959 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:49.807055 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:49.807055 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:49.807055 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:49.807055 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:49.807055 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:05:49.807055 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:05:49.807055 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:05:49.807055 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:05:49.807055 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:05:49.807055 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:05:49.807055 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 18 04:05:49.807055 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:05:49.816723 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-7a30930b-7a3d-4c11-a5fe-c10ba971041b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:49.816723 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:49.816723 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:49.816723 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:49.816723 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:49.816723 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:49.816723 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:49.816723 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:49.816723 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:49.816723 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:49.816723 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:49.816723 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:49.816723 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:05:49.816723 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:05:49.816723 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:05:49.817852 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:05:49.817852 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:49.817852 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:49.817852 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:49.817852 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:49.817852 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:49.817852 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:49.817852 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:49.817852 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:49.817852 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:49.817852 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:49.817852 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:49.817852 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:49.817852 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:49.817852 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:49.817852 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:49.817852 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:49.819124 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:05:49.819124 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:05:49.819124 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:49.819124 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:49.819124 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 313/618] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:05:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:49.819124 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a30930b-7a3d-4c11-a5fe-c10ba971041b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:49.819826 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 306/619] 10.222.0.20 () {56 vars in 1102 bytes} [Sat Jun 18 04:05:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 04:05:49.825727 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19fb3d-5c64-4ecb-adc9-d075bfbcdc76 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:49.874440 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:49.983489 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a30930b-7a3d-4c11-a5fe-c10ba971041b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:50.020555 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19fb3d-5c64-4ecb-adc9-d075bfbcdc76 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:50.052460 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31103e3-f1f6-446a-911f-9de7a89779ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:50.053209 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31103e3-f1f6-446a-911f-9de7a89779ad None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:50.053491 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31103e3-f1f6-446a-911f-9de7a89779ad None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:50.053759 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31103e3-f1f6-446a-911f-9de7a89779ad None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:50.054495 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31103e3-f1f6-446a-911f-9de7a89779ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:50.054788 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31103e3-f1f6-446a-911f-9de7a89779ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:50.056240 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31103e3-f1f6-446a-911f-9de7a89779ad None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:50.082011 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 314/620] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:05:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:50.083879 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31103e3-f1f6-446a-911f-9de7a89779ad None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:50.091527 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d232733-634d-467f-a7c0-d955e614ffc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:50.092219 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d232733-634d-467f-a7c0-d955e614ffc2 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:50.092494 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d232733-634d-467f-a7c0-d955e614ffc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:50.092787 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d232733-634d-467f-a7c0-d955e614ffc2 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:50.093543 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d232733-634d-467f-a7c0-d955e614ffc2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:50.093845 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d232733-634d-467f-a7c0-d955e614ffc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:50.095235 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d232733-634d-467f-a7c0-d955e614ffc2 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:50.115979 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 307/621] 10.222.0.20 () {56 vars in 1103 bytes} [Sat Jun 18 04:05:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:05:50.119448 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d232733-634d-467f-a7c0-d955e614ffc2 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:50.137026 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:50.241001 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:50.257247 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d232733-634d-467f-a7c0-d955e614ffc2 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:50.297650 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31103e3-f1f6-446a-911f-9de7a89779ad None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:50.323010 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59fdb08-95fb-4146-ba28-a00ffdb47fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:50.324179 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59fdb08-95fb-4146-ba28-a00ffdb47fcd None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:50.324693 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59fdb08-95fb-4146-ba28-a00ffdb47fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:50.325254 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59fdb08-95fb-4146-ba28-a00ffdb47fcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:50.339325 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59fdb08-95fb-4146-ba28-a00ffdb47fcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:50.341186 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59fdb08-95fb-4146-ba28-a00ffdb47fcd None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:50.344662 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be86e71-f33f-4397-bcfc-7e0869d8c360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:50.345484 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be86e71-f33f-4397-bcfc-7e0869d8c360 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:50.345762 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be86e71-f33f-4397-bcfc-7e0869d8c360 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:50.346034 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be86e71-f33f-4397-bcfc-7e0869d8c360 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:50.356374 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be86e71-f33f-4397-bcfc-7e0869d8c360 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:50.357879 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be86e71-f33f-4397-bcfc-7e0869d8c360 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:50.361603 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-b59fdb08-95fb-4146-ba28-a00ffdb47fcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:50.361603 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:50.361603 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:50.361603 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:50.361603 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:50.361603 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:50.361603 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:50.361603 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:50.361603 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:50.361603 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:50.361603 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:50.361603 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:50.361603 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:05:50.361603 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:05:50.361603 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:05:50.362486 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:05:50.362486 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:50.362486 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:50.362486 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:50.362486 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:50.362486 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:50.362486 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:50.362486 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:50.362486 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:50.362486 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:50.362486 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:50.362486 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:50.362486 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:50.362486 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:50.362486 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:50.362486 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:50.362486 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:50.363379 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:05:50.363379 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:05:50.363379 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:50.363379 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:05:50.365731 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 308/622] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:05:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:50.382061 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59fdb08-95fb-4146-ba28-a00ffdb47fcd None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:50.383609 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-5be86e71-f33f-4397-bcfc-7e0869d8c360 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 04:05:50.383609 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:50.383609 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:50.383609 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:50.383609 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:50.383609 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:50.383609 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:50.383609 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:50.383609 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:50.383609 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:50.383609 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:50.383609 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:50.383609 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 04:05:50.383609 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 04:05:50.383609 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 04:05:50.384536 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 04:05:50.384536 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:50.384536 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:50.384536 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:50.384536 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:50.384536 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:50.384536 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:50.384536 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:50.384536 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:50.384536 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:50.384536 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:50.384536 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:50.384536 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:50.384536 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:50.384536 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:50.384536 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:50.384536 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:50.385467 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 04:05:50.385467 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 04:05:50.385467 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 04:05:50.385467 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 04:05:50.385467 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 04:05:50.385467 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 04:05:50.385467 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 04:05:50.385467 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:50.385467 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 315/623] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Jun 18 04:05:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:50.393596 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be86e71-f33f-4397-bcfc-7e0869d8c360 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:50.503372 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:50.524468 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be86e71-f33f-4397-bcfc-7e0869d8c360 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:50.540091 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59fdb08-95fb-4146-ba28-a00ffdb47fcd None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:50.571267 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d48daf-3632-4333-b49d-d824471f86c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:50.572191 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d48daf-3632-4333-b49d-d824471f86c9 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:50.572397 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d48daf-3632-4333-b49d-d824471f86c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:50.572647 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d48daf-3632-4333-b49d-d824471f86c9 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:50.573437 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d48daf-3632-4333-b49d-d824471f86c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:50.573771 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d48daf-3632-4333-b49d-d824471f86c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:50.575156 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d48daf-3632-4333-b49d-d824471f86c9 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:50.585061 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c10f87-f7e8-44c9-94cc-1e09e9bf03c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:50.586588 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c10f87-f7e8-44c9-94cc-1e09e9bf03c7 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:50.587084 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c10f87-f7e8-44c9-94cc-1e09e9bf03c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:50.587591 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c10f87-f7e8-44c9-94cc-1e09e9bf03c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:50.588530 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c10f87-f7e8-44c9-94cc-1e09e9bf03c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:50.589090 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c10f87-f7e8-44c9-94cc-1e09e9bf03c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:50.591563 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c10f87-f7e8-44c9-94cc-1e09e9bf03c7 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:50.593500 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 316/624] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Jun 18 04:05:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:50.594958 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682abbd-4bf7-4e58-a930-5cd18c1efc60 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:50.595207 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682abbd-4bf7-4e58-a930-5cd18c1efc60 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:50.595427 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682abbd-4bf7-4e58-a930-5cd18c1efc60 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:50.600724 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 317/625] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:05:50.601495 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d682abbd-4bf7-4e58-a930-5cd18c1efc60 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:50.602136 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:50.611544 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 309/626] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:05:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:05:50.618839 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc222b-621b-4246-add8-58915109dac3 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:50.619706 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc222b-621b-4246-add8-58915109dac3 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:50.620210 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc222b-621b-4246-add8-58915109dac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:50.640110 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-35cc222b-621b-4246-add8-58915109dac3 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:50.641423 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-35cc222b-621b-4246-add8-58915109dac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:50.711114 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 310/627] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:05:50.717467 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc222b-621b-4246-add8-58915109dac3 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:50.730212 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d682abbd-4bf7-4e58-a930-5cd18c1efc60 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:50.766880 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee71116-3fa6-492f-a0b3-09ee3f488690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:50.767779 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee71116-3fa6-492f-a0b3-09ee3f488690 None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:50.768079 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee71116-3fa6-492f-a0b3-09ee3f488690 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:50.768346 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee71116-3fa6-492f-a0b3-09ee3f488690 None admin] PATH_INFO: `/v3/projects/9649aee8c5554102bc4193003300a3ad/users/fbfd82b05777466b97d46d376d4e11eb/roles/f055a7ed241c4492a4f92494099bab54` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:50.781009 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:50.784560 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee71116-3fa6-492f-a0b3-09ee3f488690 None admin] RBAC: Authorizing `identity:create_grant(project_id=9649aee8c5554102bc4193003300a3ad, user_id=fbfd82b05777466b97d46d376d4e11eb, role_id=f055a7ed241c4492a4f92494099bab54)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:50.786617 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee71116-3fa6-492f-a0b3-09ee3f488690 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:50.801606 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 318/628] 10.222.0.20 () {58 vars in 1439 bytes} [Sat Jun 18 04:05:50 2022] PUT /identity/v3/projects/9649aee8c5554102bc4193003300a3ad/users/fbfd82b05777466b97d46d376d4e11eb/roles/f055a7ed241c4492a4f92494099bab54 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 04:05:50.803187 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809db2d-1edd-4a53-80f3-e86490a3ac82 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:50.803638 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809db2d-1edd-4a53-80f3-e86490a3ac82 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:50.804065 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809db2d-1edd-4a53-80f3-e86490a3ac82 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:50.805718 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 319/629] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:05:50.806703 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a809db2d-1edd-4a53-80f3-e86490a3ac82 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:50.831501 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc222b-621b-4246-add8-58915109dac3 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:50.862365 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:50.872330 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58beaea-f504-4d6b-a44b-d00e8374a322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:50.873185 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58beaea-f504-4d6b-a44b-d00e8374a322 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:50.873511 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58beaea-f504-4d6b-a44b-d00e8374a322 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:50.873733 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58beaea-f504-4d6b-a44b-d00e8374a322 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:50.882612 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58beaea-f504-4d6b-a44b-d00e8374a322 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:50.884137 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58beaea-f504-4d6b-a44b-d00e8374a322 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:50.900885 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-b58beaea-f504-4d6b-a44b-d00e8374a322 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 18 04:05:50.900885 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:50.900885 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:50.900885 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:50.900885 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:50.900885 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:50.900885 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:50.900885 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:50.900885 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:50.900885 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:50.900885 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:50.900885 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:50.900885 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 04:05:50.900885 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 04:05:50.900885 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 04:05:50.900885 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 04:05:50.903128 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:50.903128 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:50.903128 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 04:05:50.903128 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 04:05:50.903128 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 04:05:50.903128 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 04:05:50.903128 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:50.903128 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:50.903128 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:50.903128 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:50.903128 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:50.903128 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:50.903128 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:50.903128 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:50.903128 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:50.903128 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:50.903128 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:50.903128 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:50.905417 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:50.905417 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:50.905417 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 04:05:50.905417 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 04:05:50.905417 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 04:05:50.905417 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 04:05:50.905417 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 04:05:50.905417 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 04:05:50.905417 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 18 04:05:50.905417 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:05:50.907013 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 311/630] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Jun 18 04:05:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:50.908535 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41d4b9-a17f-4b35-93d7-e31a5b1356e0 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:50.908918 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41d4b9-a17f-4b35-93d7-e31a5b1356e0 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:50.909202 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41d4b9-a17f-4b35-93d7-e31a5b1356e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:50.928224 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-ac41d4b9-a17f-4b35-93d7-e31a5b1356e0 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:50.929503 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ac41d4b9-a17f-4b35-93d7-e31a5b1356e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:50.963474 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a809db2d-1edd-4a53-80f3-e86490a3ac82 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:51.013553 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd4b67-cc0f-45ef-8000-d6eea39c9ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:51.015179 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd4b67-cc0f-45ef-8000-d6eea39c9ca0 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:51.015648 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd4b67-cc0f-45ef-8000-d6eea39c9ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:51.016069 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd4b67-cc0f-45ef-8000-d6eea39c9ca0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:51.026373 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 312/631] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:05:51.027251 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac41d4b9-a17f-4b35-93d7-e31a5b1356e0 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:51.028449 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dd4b67-cc0f-45ef-8000-d6eea39c9ca0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:05:51.037355 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-a5dd4b67-cc0f-45ef-8000-d6eea39c9ca0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 18 04:05:51.037355 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:51.037355 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:51.037355 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:51.037355 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:51.037355 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:51.037355 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:51.037355 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:51.037355 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:51.037355 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:51.037355 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:51.037355 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:51.037355 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:05:51.037355 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:05:51.037355 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:05:51.037355 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:05:51.038371 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:05:51.038371 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:05:51.038371 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:05:51.038371 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:05:51.038371 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:51.038371 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:51.038371 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:51.038371 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:51.038371 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:51.038371 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:51.038371 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:51.038371 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:51.038371 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:51.038371 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:51.038371 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:51.038371 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:51.039242 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:51.039242 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:51.039242 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:51.039242 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:51.039242 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:05:51.039242 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:05:51.039242 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:05:51.039242 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:05:51.039242 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:05:51.039242 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:05:51.039242 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 18 04:05:51.039242 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:51.040657 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 320/632] 10.222.0.20 () {56 vars in 1102 bytes} [Sat Jun 18 04:05:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:51.045345 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd4b67-cc0f-45ef-8000-d6eea39c9ca0 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:51.111148 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:51.162524 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac41d4b9-a17f-4b35-93d7-e31a5b1356e0 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:51.175148 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd4b67-cc0f-45ef-8000-d6eea39c9ca0 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:51.182493 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:51.207669 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d39a4d-ca26-4b3f-89f1-0a60704dfccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:51.208805 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d39a4d-ca26-4b3f-89f1-0a60704dfccf None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:51.209080 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d39a4d-ca26-4b3f-89f1-0a60704dfccf None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:51.209606 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d39a4d-ca26-4b3f-89f1-0a60704dfccf None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:51.210461 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d39a4d-ca26-4b3f-89f1-0a60704dfccf None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:51.211036 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d39a4d-ca26-4b3f-89f1-0a60704dfccf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:51.213242 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d39a4d-ca26-4b3f-89f1-0a60704dfccf None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:51.219846 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8758bd9-a759-434e-a368-65ddedc12264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:51.220534 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8758bd9-a759-434e-a368-65ddedc12264 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:51.220948 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8758bd9-a759-434e-a368-65ddedc12264 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:51.221290 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8758bd9-a759-434e-a368-65ddedc12264 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:51.222167 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8758bd9-a759-434e-a368-65ddedc12264 None admin] RBAC: Adding query filter params (name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:51.222537 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8758bd9-a759-434e-a368-65ddedc12264 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:51.224012 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8758bd9-a759-434e-a368-65ddedc12264 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:51.242253 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 313/634] 10.222.0.20 () {56 vars in 1137 bytes} [Sat Jun 18 04:05:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:51.243276 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d39a4d-ca26-4b3f-89f1-0a60704dfccf None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:51.245063 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 321/634] 10.222.0.20 () {56 vars in 1103 bytes} [Sat Jun 18 04:05:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:05:51.245963 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8758bd9-a759-434e-a368-65ddedc12264 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:51.357607 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8758bd9-a759-434e-a368-65ddedc12264 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:51.374451 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d39a4d-ca26-4b3f-89f1-0a60704dfccf None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:51.392957 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:51.401308 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e7cc0f-9852-4fe0-9123-76e6b4123222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:51.402243 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7cc0f-9852-4fe0-9123-76e6b4123222 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:51.402778 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7cc0f-9852-4fe0-9123-76e6b4123222 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:51.403360 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7cc0f-9852-4fe0-9123-76e6b4123222 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:51.410956 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8b138-196d-4778-b058-af1b10cb83e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:51.411753 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8b138-196d-4778-b058-af1b10cb83e0 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:51.412030 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8b138-196d-4778-b058-af1b10cb83e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:51.412308 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8b138-196d-4778-b058-af1b10cb83e0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:51.423778 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb8b138-196d-4778-b058-af1b10cb83e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:05:51.432396 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-beb8b138-196d-4778-b058-af1b10cb83e0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 18 04:05:51.432396 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:51.432396 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:51.432396 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:51.432396 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:51.432396 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:51.432396 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:51.432396 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:51.432396 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:51.432396 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:51.432396 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:51.432396 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:51.432396 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:05:51.432396 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:05:51.432396 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:05:51.432396 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:05:51.433412 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:05:51.433412 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:05:51.433412 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:05:51.433412 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:05:51.433412 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:51.433412 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:51.433412 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:51.433412 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:51.433412 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:51.433412 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:51.433412 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:51.433412 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:51.433412 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:51.433412 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:51.433412 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:51.433412 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:51.434262 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:51.434262 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:51.434262 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:51.434262 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:51.434262 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:05:51.434262 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:05:51.434262 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:05:51.434262 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:05:51.434262 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:05:51.434262 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:05:51.434262 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 18 04:05:51.434262 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:05:51.436726 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 314/635] 10.222.0.20 () {56 vars in 1102 bytes} [Sat Jun 18 04:05:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:51.437756 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8b138-196d-4778-b058-af1b10cb83e0 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:51.473259 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:51.477136 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e7cc0f-9852-4fe0-9123-76e6b4123222 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:51.479116 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e7cc0f-9852-4fe0-9123-76e6b4123222 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:51.538491 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8b138-196d-4778-b058-af1b10cb83e0 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:51.572970 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b9541-24ce-45f2-9c34-4301ed451064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:51.574062 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b9541-24ce-45f2-9c34-4301ed451064 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:51.574524 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b9541-24ce-45f2-9c34-4301ed451064 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:51.574952 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b9541-24ce-45f2-9c34-4301ed451064 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:51.585812 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2b9541-24ce-45f2-9c34-4301ed451064 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:51.587257 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2b9541-24ce-45f2-9c34-4301ed451064 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:51.593742 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 322/636] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Jun 18 04:05:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 04:05:51.593742 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7609bc1-214d-483a-812e-e364c8e0214a None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:51.593742 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7609bc1-214d-483a-812e-e364c8e0214a None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:51.593742 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7609bc1-214d-483a-812e-e364c8e0214a None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:51.593742 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 323/637] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:05:51.593742 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7609bc1-214d-483a-812e-e364c8e0214a None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:51.610893 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:51.612834 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-fc2b9541-24ce-45f2-9c34-4301ed451064 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:51.612834 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:51.612834 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:51.612834 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:51.612834 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:51.612834 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:51.612834 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:51.612834 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:51.612834 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:51.612834 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:51.612834 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:51.612834 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:51.612834 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:05:51.612834 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:05:51.612834 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:05:51.613748 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:05:51.613748 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:51.613748 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:51.613748 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:51.613748 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:51.613748 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:51.613748 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:51.613748 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:51.613748 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:51.613748 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:51.613748 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:51.613748 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:51.613748 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:51.613748 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:51.613748 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:51.613748 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:51.613748 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:51.614634 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:05:51.614634 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:05:51.614634 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:51.614634 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:05:51.614634 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 315/638] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:05:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:51.614933 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b9541-24ce-45f2-9c34-4301ed451064 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:51.708418 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:51.712494 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7609bc1-214d-483a-812e-e364c8e0214a None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:51.722870 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b9541-24ce-45f2-9c34-4301ed451064 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:51.748329 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d2bcf-f873-4030-b544-273837eb884c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:51.748953 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d2bcf-f873-4030-b544-273837eb884c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:51.749427 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d2bcf-f873-4030-b544-273837eb884c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:51.749683 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d2bcf-f873-4030-b544-273837eb884c None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:51.750532 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27d2bcf-f873-4030-b544-273837eb884c None admin] RBAC: Adding query filter params (name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:51.750867 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27d2bcf-f873-4030-b544-273837eb884c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:51.752331 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27d2bcf-f873-4030-b544-273837eb884c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:51.761080 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 324/639] 10.222.0.20 () {56 vars in 1103 bytes} [Sat Jun 18 04:05:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:51.761080 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b953fff-19be-4211-93d2-e305e81ca73f None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:51.761080 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b953fff-19be-4211-93d2-e305e81ca73f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:51.761080 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b953fff-19be-4211-93d2-e305e81ca73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:51.766213 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c502ad1-c767-481d-bef9-2c937a4cb7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:51.767116 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c502ad1-c767-481d-bef9-2c937a4cb7a0 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:51.767394 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c502ad1-c767-481d-bef9-2c937a4cb7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:51.767672 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c502ad1-c767-481d-bef9-2c937a4cb7a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:51.779824 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c502ad1-c767-481d-bef9-2c937a4cb7a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:51.779981 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-3b953fff-19be-4211-93d2-e305e81ca73f None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:51.781116 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3b953fff-19be-4211-93d2-e305e81ca73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:51.781331 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c502ad1-c767-481d-bef9-2c937a4cb7a0 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:51.799799 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-6c502ad1-c767-481d-bef9-2c937a4cb7a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:51.799799 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:51.799799 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:51.799799 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:51.799799 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:51.799799 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:51.799799 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:51.799799 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:51.799799 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:51.799799 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:51.799799 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:51.799799 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:51.799799 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:05:51.799799 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:05:51.799799 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:05:51.800731 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:05:51.800731 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:51.800731 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:51.800731 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:51.800731 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:51.800731 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:51.800731 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:51.800731 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:51.800731 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:51.800731 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:51.800731 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:51.800731 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:51.800731 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:51.800731 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:51.800731 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:51.800731 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:51.800731 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:51.801609 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:05:51.801609 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:05:51.801609 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:51.801609 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:05:51.805577 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 316/640] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:05:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:51.806300 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c502ad1-c767-481d-bef9-2c937a4cb7a0 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:51.852630 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 325/641] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:05:51.852630 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b953fff-19be-4211-93d2-e305e81ca73f None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:51.867031 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:51.924678 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c502ad1-c767-481d-bef9-2c937a4cb7a0 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:51.960401 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc2391c-f8ff-416c-bd73-d5480c406a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:51.963834 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2391c-f8ff-416c-bd73-d5480c406a18 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:51.964129 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2391c-f8ff-416c-bd73-d5480c406a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:51.964404 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2391c-f8ff-416c-bd73-d5480c406a18 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:51.965171 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc2391c-f8ff-416c-bd73-d5480c406a18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:51.965483 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc2391c-f8ff-416c-bd73-d5480c406a18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:51.967065 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc2391c-f8ff-416c-bd73-d5480c406a18 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:51.967327 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b953fff-19be-4211-93d2-e305e81ca73f None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:51.977148 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:51.986258 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 317/642] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:05:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:51.987172 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc2391c-f8ff-416c-bd73-d5480c406a18 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:52.007498 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1b61e-fef2-42b7-bf9d-a8cec645dc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:52.008223 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1b61e-fef2-42b7-bf9d-a8cec645dc95 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:52.008496 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1b61e-fef2-42b7-bf9d-a8cec645dc95 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:52.008799 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1b61e-fef2-42b7-bf9d-a8cec645dc95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:52.020487 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c1b61e-fef2-42b7-bf9d-a8cec645dc95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:52.021997 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c1b61e-fef2-42b7-bf9d-a8cec645dc95 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:52.040669 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-d8c1b61e-fef2-42b7-bf9d-a8cec645dc95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:52.040669 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:52.040669 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:52.040669 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:52.040669 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:52.040669 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:52.040669 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:52.040669 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:52.040669 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:52.040669 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:52.040669 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:52.040669 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:52.040669 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:05:52.040669 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:05:52.040669 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:05:52.041650 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:05:52.041650 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:52.041650 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:52.041650 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:52.041650 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:52.041650 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:52.041650 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:52.041650 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:52.041650 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:52.041650 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:52.041650 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:52.041650 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:52.041650 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:52.041650 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:52.041650 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:52.041650 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:52.041650 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:52.042529 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:05:52.042529 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:05:52.042529 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:52.042529 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:52.042529 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 326/643] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:05:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:52.042809 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1b61e-fef2-42b7-bf9d-a8cec645dc95 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:52.101032 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc2391c-f8ff-416c-bd73-d5480c406a18 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:52.104122 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:52.136964 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce04b73f-112f-46d5-aab7-3ce8a9cb2241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:52.137937 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04b73f-112f-46d5-aab7-3ce8a9cb2241 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:52.138387 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04b73f-112f-46d5-aab7-3ce8a9cb2241 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:52.138827 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04b73f-112f-46d5-aab7-3ce8a9cb2241 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:52.139882 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce04b73f-112f-46d5-aab7-3ce8a9cb2241 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:52.140186 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce04b73f-112f-46d5-aab7-3ce8a9cb2241 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:52.141589 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce04b73f-112f-46d5-aab7-3ce8a9cb2241 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:52.147900 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1b61e-fef2-42b7-bf9d-a8cec645dc95 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:52.153675 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 318/644] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:05:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:52.154666 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce04b73f-112f-46d5-aab7-3ce8a9cb2241 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:52.184616 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23718977-466d-47e3-b555-760ffcaef720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:52.185418 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23718977-466d-47e3-b555-760ffcaef720 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:52.185699 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23718977-466d-47e3-b555-760ffcaef720 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:52.185974 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23718977-466d-47e3-b555-760ffcaef720 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:52.195851 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23718977-466d-47e3-b555-760ffcaef720 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:05:52.203637 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-23718977-466d-47e3-b555-760ffcaef720 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 18 04:05:52.203637 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:52.203637 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:52.203637 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:52.203637 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:52.203637 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:52.203637 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:52.203637 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:52.203637 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:52.203637 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:52.203637 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:52.203637 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:52.203637 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:05:52.203637 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:05:52.203637 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:05:52.203637 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:05:52.204535 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:05:52.204535 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:05:52.204535 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:05:52.204535 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:05:52.204535 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:52.204535 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:52.204535 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:52.204535 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:52.204535 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:52.204535 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:52.204535 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:52.204535 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:52.204535 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:52.204535 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:52.204535 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:52.204535 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:52.205448 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:52.205448 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:52.205448 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:52.205448 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:52.205448 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:05:52.205448 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:05:52.205448 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:05:52.205448 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:05:52.205448 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:05:52.205448 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:05:52.205448 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 18 04:05:52.205448 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:52.205448 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 327/645] 10.222.0.20 () {56 vars in 1102 bytes} [Sat Jun 18 04:05:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:52.206249 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23718977-466d-47e3-b555-760ffcaef720 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:52.226748 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:52.275594 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce04b73f-112f-46d5-aab7-3ce8a9cb2241 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:52.310940 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026e629-bb81-4436-96cc-df37528561df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:52.312131 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026e629-bb81-4436-96cc-df37528561df None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:52.312657 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026e629-bb81-4436-96cc-df37528561df None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:52.313113 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026e629-bb81-4436-96cc-df37528561df None admin] PATH_INFO: `/v3/users/nova` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:52.318332 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23718977-466d-47e3-b555-760ffcaef720 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:52.321127 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e026e629-bb81-4436-96cc-df37528561df None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:52.322739 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e026e629-bb81-4436-96cc-df37528561df None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:52.335751 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:52.338434 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-e026e629-bb81-4436-96cc-df37528561df None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 18 04:05:52.338434 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:52.338434 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:52.338434 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:52.338434 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:52.338434 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:52.338434 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:52.338434 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:52.338434 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:52.338434 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:52.338434 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:52.338434 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:52.338434 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 04:05:52.338434 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 04:05:52.338434 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 04:05:52.338434 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 04:05:52.339464 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:52.339464 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:52.339464 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 04:05:52.339464 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 04:05:52.339464 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 04:05:52.339464 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 04:05:52.339464 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:52.339464 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:52.339464 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:52.339464 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:52.339464 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:52.339464 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:52.339464 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:52.339464 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:52.339464 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:52.339464 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:52.339464 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:52.339464 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:52.340537 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:52.340537 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:52.340537 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 04:05:52.340537 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 04:05:52.340537 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 04:05:52.340537 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 04:05:52.340537 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 04:05:52.340537 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 04:05:52.340537 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 18 04:05:52.340537 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:05:52.346574 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 319/646] 10.222.0.20 () {56 vars in 1093 bytes} [Sat Jun 18 04:05:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:52.346574 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026e629-bb81-4436-96cc-df37528561df None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:52.357839 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e4545f-c05b-43eb-be63-d4bc91d9f115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:52.358521 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e4545f-c05b-43eb-be63-d4bc91d9f115 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:52.358800 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e4545f-c05b-43eb-be63-d4bc91d9f115 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:52.359068 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e4545f-c05b-43eb-be63-d4bc91d9f115 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:52.360478 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e4545f-c05b-43eb-be63-d4bc91d9f115 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:52.360478 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e4545f-c05b-43eb-be63-d4bc91d9f115 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:52.361880 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e4545f-c05b-43eb-be63-d4bc91d9f115 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:52.375328 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 328/647] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:05:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:52.376325 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e4545f-c05b-43eb-be63-d4bc91d9f115 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:52.454492 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026e629-bb81-4436-96cc-df37528561df None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:52.475008 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:52.481364 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e4545f-c05b-43eb-be63-d4bc91d9f115 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:52.495040 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515031f1-295f-48a0-b02d-33fa32f42652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:52.496063 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515031f1-295f-48a0-b02d-33fa32f42652 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:52.496722 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515031f1-295f-48a0-b02d-33fa32f42652 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:52.496998 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515031f1-295f-48a0-b02d-33fa32f42652 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:52.505339 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515031f1-295f-48a0-b02d-33fa32f42652 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:52.507367 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515031f1-295f-48a0-b02d-33fa32f42652 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:52.516177 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09e718-edc7-46b6-9698-bf21a038a55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:52.516877 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09e718-edc7-46b6-9698-bf21a038a55b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:52.517164 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09e718-edc7-46b6-9698-bf21a038a55b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:52.517426 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09e718-edc7-46b6-9698-bf21a038a55b None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:52.518177 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f09e718-edc7-46b6-9698-bf21a038a55b None admin] RBAC: Adding query filter params (name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:52.518487 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f09e718-edc7-46b6-9698-bf21a038a55b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:52.519842 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f09e718-edc7-46b6-9698-bf21a038a55b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:52.523470 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-515031f1-295f-48a0-b02d-33fa32f42652 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 04:05:52.523470 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:52.523470 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:52.523470 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:52.523470 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:52.523470 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:52.523470 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:52.523470 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:52.523470 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:52.523470 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:52.523470 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:52.523470 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:52.523470 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 04:05:52.523470 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 04:05:52.523470 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 04:05:52.524328 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 04:05:52.524328 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:52.524328 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:52.524328 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:52.524328 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:52.524328 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:52.524328 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:52.524328 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:52.524328 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:52.524328 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:52.524328 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:52.524328 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:52.524328 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:52.524328 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:52.524328 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:52.524328 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:52.524328 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:52.530947 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 04:05:52.530947 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 04:05:52.530947 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 04:05:52.530947 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 04:05:52.530947 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 04:05:52.530947 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 04:05:52.530947 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 04:05:52.530947 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:05:52.530947 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 320/648] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Jun 18 04:05:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:52.530947 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515031f1-295f-48a0-b02d-33fa32f42652 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:52.531544 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 329/649] 10.222.0.20 () {56 vars in 1103 bytes} [Sat Jun 18 04:05:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:52.531544 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09e718-edc7-46b6-9698-bf21a038a55b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:52.580377 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:52.643312 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09e718-edc7-46b6-9698-bf21a038a55b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:52.646220 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515031f1-295f-48a0-b02d-33fa32f42652 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:52.677891 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24540a62-c70f-4a0d-9855-ee50ab915178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:52.678721 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24540a62-c70f-4a0d-9855-ee50ab915178 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:52.679003 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24540a62-c70f-4a0d-9855-ee50ab915178 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:52.679281 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24540a62-c70f-4a0d-9855-ee50ab915178 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:52.684104 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e9ebf-7fed-4ccc-b951-0d53c0495a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:52.684799 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e9ebf-7fed-4ccc-b951-0d53c0495a02 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:52.685168 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e9ebf-7fed-4ccc-b951-0d53c0495a02 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:52.685500 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e9ebf-7fed-4ccc-b951-0d53c0495a02 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:52.686344 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141e9ebf-7fed-4ccc-b951-0d53c0495a02 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:52.686638 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141e9ebf-7fed-4ccc-b951-0d53c0495a02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:52.688056 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141e9ebf-7fed-4ccc-b951-0d53c0495a02 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:52.689054 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24540a62-c70f-4a0d-9855-ee50ab915178 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:52.690486 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24540a62-c70f-4a0d-9855-ee50ab915178 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:52.705126 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-24540a62-c70f-4a0d-9855-ee50ab915178 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 18 04:05:52.705126 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:52.705126 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:52.705126 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:52.705126 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:52.705126 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:52.705126 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:52.705126 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:52.705126 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:52.705126 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:52.705126 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:52.705126 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:52.705126 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 04:05:52.705126 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 04:05:52.705126 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 04:05:52.705126 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 04:05:52.706104 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:52.706104 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:52.706104 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 04:05:52.706104 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 04:05:52.706104 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 04:05:52.706104 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 04:05:52.706104 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:52.706104 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:52.706104 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:52.706104 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:52.706104 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:52.706104 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:52.706104 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:52.706104 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:52.706104 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:52.706104 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:52.706104 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:52.706104 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:52.711877 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:52.711877 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:52.711877 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 04:05:52.711877 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 04:05:52.711877 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 04:05:52.711877 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 04:05:52.711877 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 04:05:52.711877 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 04:05:52.711877 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 18 04:05:52.711877 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:52.711877 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 330/650] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Jun 18 04:05:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:52.711877 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24540a62-c70f-4a0d-9855-ee50ab915178 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:52.712598 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 321/651] 10.222.0.20 () {56 vars in 1133 bytes} [Sat Jun 18 04:05:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:52.712598 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e9ebf-7fed-4ccc-b951-0d53c0495a02 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:52.754061 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:52.814965 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:52.818485 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24540a62-c70f-4a0d-9855-ee50ab915178 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:52.821713 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e9ebf-7fed-4ccc-b951-0d53c0495a02 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:52.854315 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36188f41-8172-4f3a-b7d4-0ba851903762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:52.854315 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36188f41-8172-4f3a-b7d4-0ba851903762 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:52.854315 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36188f41-8172-4f3a-b7d4-0ba851903762 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:52.855836 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36188f41-8172-4f3a-b7d4-0ba851903762 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:52.855836 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36188f41-8172-4f3a-b7d4-0ba851903762 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:52.855836 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36188f41-8172-4f3a-b7d4-0ba851903762 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:52.857263 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36188f41-8172-4f3a-b7d4-0ba851903762 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:52.860506 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837384c5-c83e-428e-acef-b5aa4f357fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:52.861929 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837384c5-c83e-428e-acef-b5aa4f357fff None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:52.862210 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837384c5-c83e-428e-acef-b5aa4f357fff None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:52.862481 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837384c5-c83e-428e-acef-b5aa4f357fff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:52.870089 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 331/652] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Jun 18 04:05:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:52.870715 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36188f41-8172-4f3a-b7d4-0ba851903762 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:52.879027 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837384c5-c83e-428e-acef-b5aa4f357fff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:52.880493 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837384c5-c83e-428e-acef-b5aa4f357fff None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:52.899469 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-837384c5-c83e-428e-acef-b5aa4f357fff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:52.899469 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:52.899469 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:52.899469 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:52.899469 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:52.899469 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:52.899469 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:52.899469 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:52.899469 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:52.899469 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:52.899469 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:52.899469 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:52.899469 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:05:52.899469 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:05:52.899469 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:05:52.900524 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:05:52.900524 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:52.900524 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:52.900524 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:52.900524 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:52.900524 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:52.900524 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:52.900524 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:52.900524 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:52.900524 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:52.900524 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:52.900524 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:52.900524 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:52.900524 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:52.900524 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:52.900524 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:52.900524 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:52.901482 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:05:52.901482 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:05:52.901482 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:52.901482 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:05:52.901482 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 322/653] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:05:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:52.901761 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837384c5-c83e-428e-acef-b5aa4f357fff None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:52.979433 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36188f41-8172-4f3a-b7d4-0ba851903762 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:52.999006 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:53.008979 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837384c5-c83e-428e-acef-b5aa4f357fff None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:53.013439 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef72223-290f-4a7c-84e8-07e4447cd9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:53.014085 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef72223-290f-4a7c-84e8-07e4447cd9e8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:53.014356 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef72223-290f-4a7c-84e8-07e4447cd9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:53.014618 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef72223-290f-4a7c-84e8-07e4447cd9e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:53.041852 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:53.042396 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadccb53-2b81-4c40-99ce-124321dd80ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:53.042969 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadccb53-2b81-4c40-99ce-124321dd80ee None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:53.043249 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadccb53-2b81-4c40-99ce-124321dd80ee None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:53.043554 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadccb53-2b81-4c40-99ce-124321dd80ee None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:53.044373 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadccb53-2b81-4c40-99ce-124321dd80ee None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:53.044708 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadccb53-2b81-4c40-99ce-124321dd80ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:53.046145 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadccb53-2b81-4c40-99ce-124321dd80ee None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:53.063243 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 323/654] 10.222.0.20 () {56 vars in 1137 bytes} [Sat Jun 18 04:05:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:53.064028 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadccb53-2b81-4c40-99ce-124321dd80ee None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:53.086351 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef72223-290f-4a7c-84e8-07e4447cd9e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:53.087837 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef72223-290f-4a7c-84e8-07e4447cd9e8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:53.160862 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadccb53-2b81-4c40-99ce-124321dd80ee None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:53.187807 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 332/655] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Jun 18 04:05:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 04:05:53.188671 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef72223-290f-4a7c-84e8-07e4447cd9e8 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:53.195994 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4f912-f853-4150-a722-f2d0dd85161e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:53.196702 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4f912-f853-4150-a722-f2d0dd85161e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:53.196989 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4f912-f853-4150-a722-f2d0dd85161e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:53.197262 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4f912-f853-4150-a722-f2d0dd85161e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:53.198092 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4f912-f853-4150-a722-f2d0dd85161e None admin] RBAC: Adding query filter params (role.id=f055a7ed241c4492a4f92494099bab54, scope.project.id=9649aee8c5554102bc4193003300a3ad, user.id=2a6f686b7cfa455d82559e69ee0a4d7f) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:53.198400 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4f912-f853-4150-a722-f2d0dd85161e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:53.199818 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4f912-f853-4150-a722-f2d0dd85161e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:53.205812 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 324/656] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Jun 18 04:05:53 2022] GET /identity/v3/role_assignments?user.id=2a6f686b7cfa455d82559e69ee0a4d7f&scope.project.id=9649aee8c5554102bc4193003300a3ad&role.id=f055a7ed241c4492a4f92494099bab54 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:53.207001 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c5f2f-fe3e-419e-88d2-ec30552f1488 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:53.207280 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c5f2f-fe3e-419e-88d2-ec30552f1488 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:53.207543 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c5f2f-fe3e-419e-88d2-ec30552f1488 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:53.213293 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 325/657] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:05:53.213293 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c5f2f-fe3e-419e-88d2-ec30552f1488 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:53.230179 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:53.257475 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:53.305372 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef72223-290f-4a7c-84e8-07e4447cd9e8 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:53.328080 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c5f2f-fe3e-419e-88d2-ec30552f1488 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:53.344616 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4773ad7d-371e-40d2-94eb-6f736d0208b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:53.345215 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773ad7d-371e-40d2-94eb-6f736d0208b7 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:53.345491 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773ad7d-371e-40d2-94eb-6f736d0208b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:53.345763 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773ad7d-371e-40d2-94eb-6f736d0208b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:53.346500 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4773ad7d-371e-40d2-94eb-6f736d0208b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:53.346803 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4773ad7d-371e-40d2-94eb-6f736d0208b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:53.348440 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4773ad7d-371e-40d2-94eb-6f736d0208b7 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:53.362517 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 333/658] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:05:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:53.364314 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4773ad7d-371e-40d2-94eb-6f736d0208b7 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:53.367695 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4213cb5d-6d9f-4414-a49b-812ae5d56e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:53.368354 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213cb5d-6d9f-4414-a49b-812ae5d56e24 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:53.368762 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213cb5d-6d9f-4414-a49b-812ae5d56e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:53.369035 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213cb5d-6d9f-4414-a49b-812ae5d56e24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:53.444044 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4213cb5d-6d9f-4414-a49b-812ae5d56e24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:53.445538 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4213cb5d-6d9f-4414-a49b-812ae5d56e24 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:53.459730 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:53.480686 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4773ad7d-371e-40d2-94eb-6f736d0208b7 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:53.503735 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:53.520090 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a22f3-b549-4657-97f0-5f91f822849d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:53.520912 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a22f3-b549-4657-97f0-5f91f822849d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:53.521183 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a22f3-b549-4657-97f0-5f91f822849d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:53.522125 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a22f3-b549-4657-97f0-5f91f822849d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:53.532811 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210a22f3-b549-4657-97f0-5f91f822849d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:53.534543 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210a22f3-b549-4657-97f0-5f91f822849d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:53.551571 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-210a22f3-b549-4657-97f0-5f91f822849d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:53.551571 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:53.551571 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:53.551571 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:53.551571 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:53.551571 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:53.551571 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:53.551571 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:53.551571 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:53.551571 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:53.551571 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:53.551571 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:53.551571 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:05:53.551571 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:05:53.551571 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:05:53.552472 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:05:53.552472 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:53.552472 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:53.552472 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:53.552472 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:53.552472 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:53.552472 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:53.552472 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:53.552472 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:53.552472 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:53.552472 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:53.552472 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:53.552472 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:53.552472 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:53.552472 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:53.552472 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:53.552472 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:53.553647 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:05:53.553647 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:05:53.553647 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:53.553647 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:53.553647 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 334/659] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:05:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:53.554288 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6a941-167e-4853-a8c9-0ce2a540e47f None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:53.554563 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6a941-167e-4853-a8c9-0ce2a540e47f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:53.554831 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6a941-167e-4853-a8c9-0ce2a540e47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:53.562778 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 326/660] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Jun 18 04:05:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 04:05:53.562778 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4213cb5d-6d9f-4414-a49b-812ae5d56e24 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:53.576606 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-94c6a941-167e-4853-a8c9-0ce2a540e47f None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:53.577795 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-94c6a941-167e-4853-a8c9-0ce2a540e47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:53.646458 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 335/661] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:05:53.653664 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c6a941-167e-4853-a8c9-0ce2a540e47f None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:53.669884 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4213cb5d-6d9f-4414-a49b-812ae5d56e24 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:53.683572 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:53.707474 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2913fb4-f7fd-4c51-9c4a-8f5940f84bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:53.708279 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2913fb4-f7fd-4c51-9c4a-8f5940f84bd8 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:53.708550 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2913fb4-f7fd-4c51-9c4a-8f5940f84bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:53.708847 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2913fb4-f7fd-4c51-9c4a-8f5940f84bd8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:53.716237 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2913fb4-f7fd-4c51-9c4a-8f5940f84bd8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:53.717710 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2913fb4-f7fd-4c51-9c4a-8f5940f84bd8 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:53.733383 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-c2913fb4-f7fd-4c51-9c4a-8f5940f84bd8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 18 04:05:53.733383 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:53.733383 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:53.733383 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:53.733383 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:53.733383 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:53.733383 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:53.733383 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:53.733383 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:53.733383 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:53.733383 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:53.733383 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:53.733383 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 04:05:53.733383 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 04:05:53.733383 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 04:05:53.733383 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 04:05:53.734897 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:53.734897 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:53.734897 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 04:05:53.734897 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 04:05:53.734897 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 04:05:53.734897 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 04:05:53.734897 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:53.734897 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:53.734897 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:53.734897 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:53.734897 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:53.734897 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:53.734897 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:53.734897 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:53.734897 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:53.734897 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:53.734897 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:53.734897 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:53.737369 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:53.737369 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:53.737369 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 04:05:53.737369 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 04:05:53.737369 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 04:05:53.737369 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 04:05:53.737369 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 04:05:53.737369 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 04:05:53.737369 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 18 04:05:53.737369 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:05:53.737369 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 327/662] 10.222.0.20 () {56 vars in 1102 bytes} [Sat Jun 18 04:05:53 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:53.737369 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2913fb4-f7fd-4c51-9c4a-8f5940f84bd8 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:53.773444 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c6a941-167e-4853-a8c9-0ce2a540e47f None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:53.775222 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:53.808609 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf4a92-66d1-41b2-a422-158a30222431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:53.809367 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf4a92-66d1-41b2-a422-158a30222431 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:53.809719 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf4a92-66d1-41b2-a422-158a30222431 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:53.809992 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf4a92-66d1-41b2-a422-158a30222431 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:53.810866 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bf4a92-66d1-41b2-a422-158a30222431 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:53.811182 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bf4a92-66d1-41b2-a422-158a30222431 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:53.812739 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bf4a92-66d1-41b2-a422-158a30222431 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:53.828818 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 336/663] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:05:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:53.828818 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf4a92-66d1-41b2-a422-158a30222431 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:53.857274 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2913fb4-f7fd-4c51-9c4a-8f5940f84bd8 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:53.894587 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c694b-871b-427c-bacb-73200d6dc91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:53.895397 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c694b-871b-427c-bacb-73200d6dc91f None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:53.895667 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c694b-871b-427c-bacb-73200d6dc91f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:53.895940 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c694b-871b-427c-bacb-73200d6dc91f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:53.906791 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0c694b-871b-427c-bacb-73200d6dc91f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:53.908161 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0c694b-871b-427c-bacb-73200d6dc91f None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:53.928148 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-dc0c694b-871b-427c-bacb-73200d6dc91f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:53.928148 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:53.928148 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:53.928148 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:53.928148 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:53.928148 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:53.928148 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:53.928148 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:53.928148 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:53.928148 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:53.928148 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:53.928148 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:53.928148 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:05:53.928148 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:05:53.928148 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:05:53.929182 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:05:53.929182 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:53.929182 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:53.929182 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:53.929182 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:53.929182 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:53.929182 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:53.929182 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:53.929182 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:53.929182 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:53.929182 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:53.929182 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:53.929182 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:53.929182 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:53.929182 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:53.929182 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:53.929182 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:53.930067 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:05:53.930067 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:05:53.930067 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:53.930067 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:05:53.932720 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 328/664] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:05:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:53.933556 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c694b-871b-427c-bacb-73200d6dc91f None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:53.937649 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf4a92-66d1-41b2-a422-158a30222431 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:53.961429 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:53.980897 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1992a8-cb4c-4850-b9e3-5f6d7837c20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:53.981771 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1992a8-cb4c-4850-b9e3-5f6d7837c20e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:53.982082 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1992a8-cb4c-4850-b9e3-5f6d7837c20e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:53.982421 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1992a8-cb4c-4850-b9e3-5f6d7837c20e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:53.994459 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1992a8-cb4c-4850-b9e3-5f6d7837c20e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:05:54.002891 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-8f1992a8-cb4c-4850-b9e3-5f6d7837c20e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 18 04:05:54.002891 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:54.002891 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:54.002891 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:54.002891 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:54.002891 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:54.002891 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:54.002891 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:54.002891 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:54.002891 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:54.002891 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:54.002891 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:54.002891 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:05:54.002891 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:05:54.002891 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:05:54.002891 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:05:54.003819 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:05:54.003819 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:05:54.003819 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:05:54.003819 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:05:54.003819 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:54.003819 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:54.003819 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:54.003819 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:54.003819 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:54.003819 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:54.003819 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:54.003819 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:54.003819 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:54.003819 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:54.003819 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:54.003819 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:54.004769 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:54.004769 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:54.004769 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:54.004769 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:54.004769 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:05:54.004769 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:05:54.004769 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:05:54.004769 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:05:54.004769 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:05:54.004769 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:05:54.004769 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 18 04:05:54.004769 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:54.004769 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 337/665] 10.222.0.20 () {56 vars in 1102 bytes} [Sat Jun 18 04:05:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:54.005472 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1992a8-cb4c-4850-b9e3-5f6d7837c20e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:54.031991 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:54.042645 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c694b-871b-427c-bacb-73200d6dc91f None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:54.076129 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2464dd2d-bdaa-4004-bc32-ab24c32ad4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:54.076824 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2464dd2d-bdaa-4004-bc32-ab24c32ad4b1 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:54.077128 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2464dd2d-bdaa-4004-bc32-ab24c32ad4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:54.077383 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2464dd2d-bdaa-4004-bc32-ab24c32ad4b1 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:54.078217 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2464dd2d-bdaa-4004-bc32-ab24c32ad4b1 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:54.078522 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2464dd2d-bdaa-4004-bc32-ab24c32ad4b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:54.080064 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2464dd2d-bdaa-4004-bc32-ab24c32ad4b1 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:54.102737 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 329/666] 10.222.0.20 () {56 vars in 1139 bytes} [Sat Jun 18 04:05:53 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:54.102737 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2464dd2d-bdaa-4004-bc32-ab24c32ad4b1 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:54.115301 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1992a8-cb4c-4850-b9e3-5f6d7837c20e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:54.149483 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64525db-6ee5-40c3-8e8f-b85def8dad1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:54.150451 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64525db-6ee5-40c3-8e8f-b85def8dad1a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:54.150726 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64525db-6ee5-40c3-8e8f-b85def8dad1a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:54.150997 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64525db-6ee5-40c3-8e8f-b85def8dad1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:54.158731 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64525db-6ee5-40c3-8e8f-b85def8dad1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:54.160023 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64525db-6ee5-40c3-8e8f-b85def8dad1a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:54.174274 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-a64525db-6ee5-40c3-8e8f-b85def8dad1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 04:05:54.174274 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:54.174274 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:54.174274 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:54.174274 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:54.174274 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:54.174274 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:54.174274 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:54.174274 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:54.174274 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:54.174274 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:54.174274 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:54.174274 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 04:05:54.174274 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 04:05:54.174274 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 04:05:54.175164 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 04:05:54.175164 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:54.175164 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:54.175164 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:54.175164 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:54.175164 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:54.175164 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:54.175164 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:54.175164 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:54.175164 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:54.175164 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:54.175164 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:54.175164 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:54.175164 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:54.175164 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:54.175164 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:54.175164 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:54.180988 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 04:05:54.180988 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 04:05:54.180988 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 04:05:54.180988 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 04:05:54.180988 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 04:05:54.180988 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 04:05:54.180988 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 04:05:54.180988 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:54.180988 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 338/667] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Jun 18 04:05:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:54.180988 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64525db-6ee5-40c3-8e8f-b85def8dad1a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:54.189626 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:54.209999 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2464dd2d-bdaa-4004-bc32-ab24c32ad4b1 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:54.248180 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e7f433-a034-48ed-91d6-7a340ceb05d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:54.248873 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7f433-a034-48ed-91d6-7a340ceb05d1 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:54.249150 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7f433-a034-48ed-91d6-7a340ceb05d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:54.249420 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7f433-a034-48ed-91d6-7a340ceb05d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:54.250259 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e7f433-a034-48ed-91d6-7a340ceb05d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:54.250561 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e7f433-a034-48ed-91d6-7a340ceb05d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:54.252049 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e7f433-a034-48ed-91d6-7a340ceb05d1 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:54.262693 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:54.269760 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 330/668] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:05:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:54.269760 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e7f433-a034-48ed-91d6-7a340ceb05d1 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:54.288679 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64525db-6ee5-40c3-8e8f-b85def8dad1a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:54.327562 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80081827-5350-4944-923b-3ec5bfaf61e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:54.328505 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80081827-5350-4944-923b-3ec5bfaf61e4 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:54.328922 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80081827-5350-4944-923b-3ec5bfaf61e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:54.329014 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80081827-5350-4944-923b-3ec5bfaf61e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:54.329696 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80081827-5350-4944-923b-3ec5bfaf61e4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:54.330052 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80081827-5350-4944-923b-3ec5bfaf61e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:54.331480 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80081827-5350-4944-923b-3ec5bfaf61e4 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:54.344137 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 339/669] 10.222.0.20 () {56 vars in 1103 bytes} [Sat Jun 18 04:05:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:54.344137 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80081827-5350-4944-923b-3ec5bfaf61e4 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:54.376974 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e7f433-a034-48ed-91d6-7a340ceb05d1 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:54.411876 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e3da93-05bf-4488-adbc-026a24d0328b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:54.412551 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3da93-05bf-4488-adbc-026a24d0328b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:54.412923 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3da93-05bf-4488-adbc-026a24d0328b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:54.413262 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3da93-05bf-4488-adbc-026a24d0328b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:54.425638 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:54.450409 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80081827-5350-4944-923b-3ec5bfaf61e4 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:54.482883 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e3da93-05bf-4488-adbc-026a24d0328b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:54.483880 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67371acd-523e-4e43-ba62-7388ef7856ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:54.484955 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67371acd-523e-4e43-ba62-7388ef7856ef None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:54.485073 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e3da93-05bf-4488-adbc-026a24d0328b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:54.485230 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67371acd-523e-4e43-ba62-7388ef7856ef None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:54.485495 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67371acd-523e-4e43-ba62-7388ef7856ef None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:54.486272 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67371acd-523e-4e43-ba62-7388ef7856ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:54.486571 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67371acd-523e-4e43-ba62-7388ef7856ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:54.488068 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67371acd-523e-4e43-ba62-7388ef7856ef None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:54.504735 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 340/670] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Jun 18 04:05:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:54.504735 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67371acd-523e-4e43-ba62-7388ef7856ef None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:54.509676 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:54.592271 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 331/671] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Jun 18 04:05:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 04:05:54.593243 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e3da93-05bf-4488-adbc-026a24d0328b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:54.609566 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67371acd-523e-4e43-ba62-7388ef7856ef None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:54.636249 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:54.647598 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e73dd-4f3a-4fb4-b9cb-f419e845ba4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:54.648459 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e73dd-4f3a-4fb4-b9cb-f419e845ba4b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:54.648787 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e73dd-4f3a-4fb4-b9cb-f419e845ba4b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:54.649057 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e73dd-4f3a-4fb4-b9cb-f419e845ba4b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:54.655892 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2e73dd-4f3a-4fb4-b9cb-f419e845ba4b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:54.657361 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2e73dd-4f3a-4fb4-b9cb-f419e845ba4b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:54.670887 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-6e2e73dd-4f3a-4fb4-b9cb-f419e845ba4b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 04:05:54.670887 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:54.670887 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:54.670887 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:54.670887 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:54.670887 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:54.670887 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:54.670887 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:54.670887 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:54.670887 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:54.670887 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:54.670887 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:54.670887 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 04:05:54.670887 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 04:05:54.670887 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 04:05:54.671927 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 04:05:54.671927 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:54.671927 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:54.671927 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:54.671927 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:54.671927 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:54.671927 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:54.671927 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:54.671927 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:54.671927 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:54.671927 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:54.671927 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:54.671927 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:54.671927 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:54.671927 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:54.671927 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:54.671927 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:54.677702 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 04:05:54.677702 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 04:05:54.677702 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 04:05:54.677702 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 04:05:54.677702 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 04:05:54.677702 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 04:05:54.677702 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 04:05:54.677702 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:54.677702 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 341/672] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Jun 18 04:05:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:54.677702 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e73dd-4f3a-4fb4-b9cb-f419e845ba4b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:54.703474 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e3da93-05bf-4488-adbc-026a24d0328b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:54.738949 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4cab4-a424-4bae-a99e-40cacddbc604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:54.739828 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:54.739947 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4cab4-a424-4bae-a99e-40cacddbc604 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:54.740109 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4cab4-a424-4bae-a99e-40cacddbc604 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:54.740745 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4cab4-a424-4bae-a99e-40cacddbc604 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:54.751702 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb4cab4-a424-4bae-a99e-40cacddbc604 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:54.753434 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb4cab4-a424-4bae-a99e-40cacddbc604 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:54.772083 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-1fb4cab4-a424-4bae-a99e-40cacddbc604 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:54.772083 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:54.772083 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:54.772083 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:54.772083 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:54.772083 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:54.772083 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:54.772083 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:54.772083 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:54.772083 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:54.772083 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:54.772083 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:54.772083 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:05:54.772083 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:05:54.772083 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:05:54.773145 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:05:54.773145 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:54.773145 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:54.773145 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:54.773145 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:54.773145 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:54.773145 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:54.773145 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:54.773145 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:54.773145 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:54.773145 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:54.773145 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:54.773145 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:54.773145 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:54.773145 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:54.773145 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:54.773145 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:54.774043 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:05:54.774043 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:05:54.774043 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:54.774043 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:05:54.774043 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 332/673] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:05:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:54.774043 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4cab4-a424-4bae-a99e-40cacddbc604 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:54.786719 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e73dd-4f3a-4fb4-b9cb-f419e845ba4b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:54.822676 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f816716-83d2-42c1-9774-f128ea0367e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:54.823472 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f816716-83d2-42c1-9774-f128ea0367e3 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:54.823844 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f816716-83d2-42c1-9774-f128ea0367e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:54.824228 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f816716-83d2-42c1-9774-f128ea0367e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:54.825093 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f816716-83d2-42c1-9774-f128ea0367e3 None admin] RBAC: Adding query filter params (role.id=f055a7ed241c4492a4f92494099bab54, scope.project.id=9649aee8c5554102bc4193003300a3ad, user.id=c129f3de2bb2431593fac649fd4975b3) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:54.825399 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f816716-83d2-42c1-9774-f128ea0367e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:54.826826 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f816716-83d2-42c1-9774-f128ea0367e3 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:54.832818 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 342/674] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Jun 18 04:05:54 2022] GET /identity/v3/role_assignments?user.id=c129f3de2bb2431593fac649fd4975b3&scope.project.id=9649aee8c5554102bc4193003300a3ad&role.id=f055a7ed241c4492a4f92494099bab54 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:54.833600 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f816716-83d2-42c1-9774-f128ea0367e3 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:54.893013 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:54.901328 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4cab4-a424-4bae-a99e-40cacddbc604 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:54.941255 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe05620-4dc4-49f2-9d8a-81df8f9e6547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:54.942485 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe05620-4dc4-49f2-9d8a-81df8f9e6547 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:54.942979 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe05620-4dc4-49f2-9d8a-81df8f9e6547 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:54.943570 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe05620-4dc4-49f2-9d8a-81df8f9e6547 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:54.955912 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe05620-4dc4-49f2-9d8a-81df8f9e6547 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:54.958370 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe05620-4dc4-49f2-9d8a-81df8f9e6547 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:54.982665 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f816716-83d2-42c1-9774-f128ea0367e3 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:54.983925 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-0fe05620-4dc4-49f2-9d8a-81df8f9e6547 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:54.983925 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:54.983925 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:54.983925 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:54.983925 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:54.983925 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:54.983925 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:54.983925 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:54.983925 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:54.983925 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:54.983925 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:54.983925 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:54.983925 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:05:54.983925 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:05:54.983925 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:05:54.985200 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:05:54.985200 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:54.985200 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:54.985200 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:54.985200 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:54.985200 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:54.985200 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:54.985200 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:54.985200 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:54.985200 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:54.985200 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:54.985200 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:54.985200 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:54.985200 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:54.985200 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:54.985200 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:54.985200 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:54.986114 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:05:54.986114 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:05:54.986114 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:54.986114 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:05:54.988651 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 333/675] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:05:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:54.989834 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe05620-4dc4-49f2-9d8a-81df8f9e6547 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:55.015793 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:55.027992 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50ba3b1-ffc6-49dc-87cc-39b269346758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:55.028687 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ba3b1-ffc6-49dc-87cc-39b269346758 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:55.028968 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ba3b1-ffc6-49dc-87cc-39b269346758 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:55.029239 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ba3b1-ffc6-49dc-87cc-39b269346758 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:55.033394 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50ba3b1-ffc6-49dc-87cc-39b269346758 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:55.033394 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50ba3b1-ffc6-49dc-87cc-39b269346758 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:55.033394 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50ba3b1-ffc6-49dc-87cc-39b269346758 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:55.048980 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 343/676] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Jun 18 04:05:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:55.050541 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50ba3b1-ffc6-49dc-87cc-39b269346758 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:55.116356 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe05620-4dc4-49f2-9d8a-81df8f9e6547 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:55.155077 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62115b85-d4f1-46d6-9255-823edb4b606e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:55.155747 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62115b85-d4f1-46d6-9255-823edb4b606e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:55.156026 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62115b85-d4f1-46d6-9255-823edb4b606e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:55.156619 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62115b85-d4f1-46d6-9255-823edb4b606e None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:55.157050 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62115b85-d4f1-46d6-9255-823edb4b606e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:55.157351 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62115b85-d4f1-46d6-9255-823edb4b606e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:55.158732 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62115b85-d4f1-46d6-9255-823edb4b606e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:55.169928 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50ba3b1-ffc6-49dc-87cc-39b269346758 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:55.174308 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 334/677] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:05:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:55.175251 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62115b85-d4f1-46d6-9255-823edb4b606e None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:55.185096 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:55.216814 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1162dfef-66d8-4536-93d6-d562ce1175d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:55.217946 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162dfef-66d8-4536-93d6-d562ce1175d2 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:55.218432 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162dfef-66d8-4536-93d6-d562ce1175d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:55.219414 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162dfef-66d8-4536-93d6-d562ce1175d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:55.220343 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1162dfef-66d8-4536-93d6-d562ce1175d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:55.221317 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1162dfef-66d8-4536-93d6-d562ce1175d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:55.223331 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1162dfef-66d8-4536-93d6-d562ce1175d2 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:55.239608 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 344/678] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:05:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:55.244191 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1162dfef-66d8-4536-93d6-d562ce1175d2 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:55.298248 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:55.308777 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62115b85-d4f1-46d6-9255-823edb4b606e None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:55.343903 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd78233e-5b28-415b-9dfe-220477476eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:55.344614 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd78233e-5b28-415b-9dfe-220477476eff None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:55.344904 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd78233e-5b28-415b-9dfe-220477476eff None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:55.345178 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd78233e-5b28-415b-9dfe-220477476eff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:55.346019 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd78233e-5b28-415b-9dfe-220477476eff None admin] RBAC: Adding query filter params (role.id=f055a7ed241c4492a4f92494099bab54, scope.project.id=9649aee8c5554102bc4193003300a3ad, user.id=d0e9cb2b54724d4f9f71b7b1000cf72c) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:55.346334 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd78233e-5b28-415b-9dfe-220477476eff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:55.347778 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd78233e-5b28-415b-9dfe-220477476eff None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:55.354360 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 335/679] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Jun 18 04:05:55 2022] GET /identity/v3/role_assignments?user.id=d0e9cb2b54724d4f9f71b7b1000cf72c&scope.project.id=9649aee8c5554102bc4193003300a3ad&role.id=f055a7ed241c4492a4f92494099bab54 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:55.355243 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd78233e-5b28-415b-9dfe-220477476eff None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:55.363128 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1162dfef-66d8-4536-93d6-d562ce1175d2 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:55.403402 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa64b876-1692-415d-9529-5ee9b779fef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:55.404621 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa64b876-1692-415d-9529-5ee9b779fef4 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:55.405109 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa64b876-1692-415d-9529-5ee9b779fef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:55.405603 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa64b876-1692-415d-9529-5ee9b779fef4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:55.415124 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa64b876-1692-415d-9529-5ee9b779fef4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:55.417134 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa64b876-1692-415d-9529-5ee9b779fef4 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:55.435243 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-fa64b876-1692-415d-9529-5ee9b779fef4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 18 04:05:55.435243 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:55.435243 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:55.435243 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:55.435243 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:55.435243 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:55.435243 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:55.435243 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:55.435243 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:55.435243 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:55.435243 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:55.435243 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:55.435243 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 04:05:55.435243 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 04:05:55.435243 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 04:05:55.435243 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 04:05:55.436277 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:55.436277 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:55.436277 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 04:05:55.436277 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 04:05:55.436277 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 04:05:55.436277 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 04:05:55.436277 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:55.436277 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:55.436277 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:55.436277 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:55.436277 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:55.436277 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:55.436277 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:55.436277 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:55.436277 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:55.436277 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:55.436277 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:55.436277 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:55.437252 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:55.437252 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:55.437252 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 04:05:55.437252 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 04:05:55.437252 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 04:05:55.437252 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 04:05:55.437252 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 04:05:55.437252 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 04:05:55.437252 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 18 04:05:55.437252 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:55.440194 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 345/680] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Jun 18 04:05:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:55.441984 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708463e-6269-4301-a44a-e13b7d7302e8 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:55.442479 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:55.443246 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708463e-6269-4301-a44a-e13b7d7302e8 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:55.443706 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708463e-6269-4301-a44a-e13b7d7302e8 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:55.450033 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 346/681] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:55 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:05:55.452104 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f708463e-6269-4301-a44a-e13b7d7302e8 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:55.483178 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd78233e-5b28-415b-9dfe-220477476eff None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:55.520987 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add02aaa-c6d7-4f7a-80bf-e7d6e658c0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:55.521925 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add02aaa-c6d7-4f7a-80bf-e7d6e658c0ce None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:55.522322 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add02aaa-c6d7-4f7a-80bf-e7d6e658c0ce None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:55.522661 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add02aaa-c6d7-4f7a-80bf-e7d6e658c0ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:55.530761 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add02aaa-c6d7-4f7a-80bf-e7d6e658c0ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:55.532329 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add02aaa-c6d7-4f7a-80bf-e7d6e658c0ce None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:55.547782 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-add02aaa-c6d7-4f7a-80bf-e7d6e658c0ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 04:05:55.547782 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:55.547782 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:55.547782 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:55.547782 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:55.547782 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:55.547782 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:55.547782 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:55.547782 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:55.547782 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:55.547782 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:55.547782 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:55.547782 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 04:05:55.547782 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 04:05:55.547782 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 04:05:55.548784 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 04:05:55.548784 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:55.548784 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:55.548784 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:55.548784 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:55.548784 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:55.548784 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:55.548784 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:55.548784 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:55.548784 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:55.548784 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:55.548784 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:55.548784 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:55.548784 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:55.548784 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:55.548784 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:55.548784 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:55.549767 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 04:05:55.549767 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 04:05:55.549767 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 04:05:55.549767 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 04:05:55.549767 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 04:05:55.549767 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 04:05:55.549767 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 04:05:55.549767 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:05:55.554562 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 336/682] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Jun 18 04:05:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:55.555959 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0a8e5-c50c-4f0c-b06e-647ddf413b23 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:55.556313 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0a8e5-c50c-4f0c-b06e-647ddf413b23 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:55.556607 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0a8e5-c50c-4f0c-b06e-647ddf413b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:55.576889 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-d6a0a8e5-c50c-4f0c-b06e-647ddf413b23 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:55.578083 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-d6a0a8e5-c50c-4f0c-b06e-647ddf413b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:55.589132 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f708463e-6269-4301-a44a-e13b7d7302e8 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:55.599093 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:55.631428 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85acbe54-77be-40cd-a5ce-7be83127c078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:55.632110 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85acbe54-77be-40cd-a5ce-7be83127c078 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:55.632392 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85acbe54-77be-40cd-a5ce-7be83127c078 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:55.633932 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85acbe54-77be-40cd-a5ce-7be83127c078 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:55.633932 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85acbe54-77be-40cd-a5ce-7be83127c078 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:55.633932 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85acbe54-77be-40cd-a5ce-7be83127c078 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:55.635308 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85acbe54-77be-40cd-a5ce-7be83127c078 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:55.663270 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 337/683] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:05:55.663839 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 347/684] 10.222.0.20 () {56 vars in 1135 bytes} [Sat Jun 18 04:05:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:55.664151 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a0a8e5-c50c-4f0c-b06e-647ddf413b23 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:55.677600 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85acbe54-77be-40cd-a5ce-7be83127c078 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:55.731033 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:55.778025 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a0a8e5-c50c-4f0c-b06e-647ddf413b23 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:55.816520 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85acbe54-77be-40cd-a5ce-7be83127c078 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:55.816858 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf9bfa-dcfe-4fc4-92a4-9e3622070c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:55.817533 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf9bfa-dcfe-4fc4-92a4-9e3622070c44 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:55.817814 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf9bfa-dcfe-4fc4-92a4-9e3622070c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:55.818183 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf9bfa-dcfe-4fc4-92a4-9e3622070c44 None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:55.819151 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abf9bfa-dcfe-4fc4-92a4-9e3622070c44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:55.819587 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abf9bfa-dcfe-4fc4-92a4-9e3622070c44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:55.821083 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abf9bfa-dcfe-4fc4-92a4-9e3622070c44 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:55.838854 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 338/685] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Jun 18 04:05:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:55.838854 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf9bfa-dcfe-4fc4-92a4-9e3622070c44 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:55.858014 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0762c8f8-6cee-482b-a3d9-ef2638844a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:55.859062 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762c8f8-6cee-482b-a3d9-ef2638844a98 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:55.859959 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762c8f8-6cee-482b-a3d9-ef2638844a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:55.860452 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762c8f8-6cee-482b-a3d9-ef2638844a98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:55.896541 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:55.937917 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0762c8f8-6cee-482b-a3d9-ef2638844a98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:55.939895 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0762c8f8-6cee-482b-a3d9-ef2638844a98 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:55.943429 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf9bfa-dcfe-4fc4-92a4-9e3622070c44 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:55.964528 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:55.979787 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88dfc4-5604-4171-8a76-1af9b21f3367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:55.980600 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88dfc4-5604-4171-8a76-1af9b21f3367 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:55.980909 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88dfc4-5604-4171-8a76-1af9b21f3367 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:55.981181 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88dfc4-5604-4171-8a76-1af9b21f3367 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:55.993017 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c88dfc4-5604-4171-8a76-1af9b21f3367 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:55.994521 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c88dfc4-5604-4171-8a76-1af9b21f3367 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:56.013146 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-1c88dfc4-5604-4171-8a76-1af9b21f3367 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:56.013146 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:56.013146 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:56.013146 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:56.013146 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:56.013146 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:56.013146 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:56.013146 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:56.013146 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:56.013146 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:56.013146 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:56.013146 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:56.013146 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:05:56.013146 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:05:56.013146 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:05:56.014090 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:05:56.014090 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:56.014090 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:56.014090 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:56.014090 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:56.014090 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:56.014090 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:56.014090 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:56.014090 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:56.014090 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:56.014090 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:56.014090 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:56.014090 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:56.014090 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:56.014090 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:56.014090 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:56.014090 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:56.014976 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:05:56.014976 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:05:56.014976 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:56.014976 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:05:56.019254 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 339/686] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:05:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:56.020758 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88dfc4-5604-4171-8a76-1af9b21f3367 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:56.064391 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 348/687] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Jun 18 04:05:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 04:05:56.064391 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0762c8f8-6cee-482b-a3d9-ef2638844a98 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:56.143997 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:56.148383 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88dfc4-5604-4171-8a76-1af9b21f3367 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:56.186078 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0762c8f8-6cee-482b-a3d9-ef2638844a98 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:56.188321 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85217229-c707-446a-a470-e52b98d3bf2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:56.189177 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85217229-c707-446a-a470-e52b98d3bf2d None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:56.189527 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85217229-c707-446a-a470-e52b98d3bf2d None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:56.189872 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85217229-c707-446a-a470-e52b98d3bf2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:56.190782 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85217229-c707-446a-a470-e52b98d3bf2d None admin] RBAC: Adding query filter params (role.id=f055a7ed241c4492a4f92494099bab54, scope.project.id=9649aee8c5554102bc4193003300a3ad, user.id=0798570229d943319caac5787bdcb9df) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:56.191163 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85217229-c707-446a-a470-e52b98d3bf2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:56.192685 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85217229-c707-446a-a470-e52b98d3bf2d None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:56.199730 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 340/688] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Jun 18 04:05:56 2022] GET /identity/v3/role_assignments?user.id=0798570229d943319caac5787bdcb9df&scope.project.id=9649aee8c5554102bc4193003300a3ad&role.id=f055a7ed241c4492a4f92494099bab54 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:56.200639 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85217229-c707-446a-a470-e52b98d3bf2d None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:56.239409 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:56.249396 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68d402-d922-458a-9bca-950996b084fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:56.250087 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68d402-d922-458a-9bca-950996b084fe None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:56.250363 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68d402-d922-458a-9bca-950996b084fe None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:56.250634 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68d402-d922-458a-9bca-950996b084fe None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:56.251381 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e68d402-d922-458a-9bca-950996b084fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:56.251678 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e68d402-d922-458a-9bca-950996b084fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:56.253389 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e68d402-d922-458a-9bca-950996b084fe None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:56.277660 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 349/689] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:05:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:56.284244 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68d402-d922-458a-9bca-950996b084fe None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:56.316673 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85217229-c707-446a-a470-e52b98d3bf2d None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:56.355038 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b53ea6c-b385-4c7b-8912-53deed33e474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:56.356028 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53ea6c-b385-4c7b-8912-53deed33e474 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:56.356407 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53ea6c-b385-4c7b-8912-53deed33e474 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:56.356819 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53ea6c-b385-4c7b-8912-53deed33e474 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:56.369816 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b53ea6c-b385-4c7b-8912-53deed33e474 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:56.371456 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b53ea6c-b385-4c7b-8912-53deed33e474 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:56.390546 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-0b53ea6c-b385-4c7b-8912-53deed33e474 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:56.390546 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:56.390546 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:56.390546 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:56.390546 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:56.390546 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:56.390546 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:56.390546 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:56.390546 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:56.390546 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:56.390546 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:56.390546 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:56.390546 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:05:56.390546 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:05:56.390546 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:05:56.391699 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:05:56.391699 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:56.391699 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:56.391699 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:56.391699 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:56.391699 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:56.391699 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:56.391699 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:56.391699 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:56.391699 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:56.391699 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:56.391699 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:56.391699 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:56.391699 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:56.391699 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:56.391699 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:56.391699 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:56.392835 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:05:56.392835 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:05:56.392835 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:56.392835 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:05:56.394560 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 341/690] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:05:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:56.400507 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b53ea6c-b385-4c7b-8912-53deed33e474 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:56.496848 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68d402-d922-458a-9bca-950996b084fe None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:56.499854 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:56.513717 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b53ea6c-b385-4c7b-8912-53deed33e474 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:56.526596 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:56.539133 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c5aa98-9855-4ee2-9f36-8d3f7515b7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:56.540199 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5aa98-9855-4ee2-9f36-8d3f7515b7c0 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:56.540653 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5aa98-9855-4ee2-9f36-8d3f7515b7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:56.541260 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5aa98-9855-4ee2-9f36-8d3f7515b7c0 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:56.542504 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c5aa98-9855-4ee2-9f36-8d3f7515b7c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:56.544505 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c5aa98-9855-4ee2-9f36-8d3f7515b7c0 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:56.550285 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb19d1-cd09-4b80-a082-1a6539e00023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:56.551082 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb19d1-cd09-4b80-a082-1a6539e00023 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:56.551453 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb19d1-cd09-4b80-a082-1a6539e00023 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:56.551818 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb19d1-cd09-4b80-a082-1a6539e00023 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:56.552669 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb19d1-cd09-4b80-a082-1a6539e00023 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:56.553062 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb19d1-cd09-4b80-a082-1a6539e00023 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:56.554506 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb19d1-cd09-4b80-a082-1a6539e00023 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:56.568464 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 342/691] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:05:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:56.569381 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 350/692] 10.222.0.20 () {60 vars in 1132 bytes} [Sat Jun 18 04:05:56 2022] POST /identity/v3/users => generated 254 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 04:05:56.575065 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb19d1-cd09-4b80-a082-1a6539e00023 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:56.697986 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb19d1-cd09-4b80-a082-1a6539e00023 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:56.737690 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159e376-baba-4044-8594-ca54cd075bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:56.738510 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159e376-baba-4044-8594-ca54cd075bcc None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:56.738787 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159e376-baba-4044-8594-ca54cd075bcc None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:56.739059 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159e376-baba-4044-8594-ca54cd075bcc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:56.747679 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1159e376-baba-4044-8594-ca54cd075bcc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:56.749243 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1159e376-baba-4044-8594-ca54cd075bcc None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:56.764317 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-1159e376-baba-4044-8594-ca54cd075bcc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 04:05:56.764317 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:56.764317 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:56.764317 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:56.764317 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:56.764317 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:56.764317 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:56.764317 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:56.764317 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:56.764317 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:56.764317 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:56.764317 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:56.764317 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 04:05:56.764317 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 04:05:56.764317 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 04:05:56.766671 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 04:05:56.766671 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:56.766671 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:56.766671 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:56.766671 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:56.766671 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:56.766671 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:56.766671 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:56.766671 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:56.766671 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:56.766671 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:56.766671 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:56.766671 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:56.766671 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:56.766671 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:56.766671 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:56.766671 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:56.768947 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 04:05:56.768947 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 04:05:56.768947 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 04:05:56.768947 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 04:05:56.768947 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 04:05:56.768947 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 04:05:56.768947 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 04:05:56.768947 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:05:56.768947 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 343/693] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Jun 18 04:05:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:56.777876 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c5aa98-9855-4ee2-9f36-8d3f7515b7c0 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:56.885600 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c5aa98-9855-4ee2-9f36-8d3f7515b7c0 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:56.922126 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb1c601-fd0d-4826-9b5d-5506f125d2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:56.922859 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1c601-fd0d-4826-9b5d-5506f125d2f7 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:56.923135 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1c601-fd0d-4826-9b5d-5506f125d2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:56.923409 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1c601-fd0d-4826-9b5d-5506f125d2f7 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:56.924208 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb1c601-fd0d-4826-9b5d-5506f125d2f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:56.924519 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb1c601-fd0d-4826-9b5d-5506f125d2f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:56.925981 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb1c601-fd0d-4826-9b5d-5506f125d2f7 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:56.939183 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 351/694] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Jun 18 04:05:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:56.945198 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159e376-baba-4044-8594-ca54cd075bcc None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:56.961895 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:57.055208 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159e376-baba-4044-8594-ca54cd075bcc None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:57.090358 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef0d21-c9c8-4492-a527-e37e2d863b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:57.091023 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef0d21-c9c8-4492-a527-e37e2d863b7e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:57.091301 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef0d21-c9c8-4492-a527-e37e2d863b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:57.091574 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef0d21-c9c8-4492-a527-e37e2d863b7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:57.092416 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ef0d21-c9c8-4492-a527-e37e2d863b7e None admin] RBAC: Adding query filter params (role.id=f055a7ed241c4492a4f92494099bab54, scope.project.id=9649aee8c5554102bc4193003300a3ad, user.id=fbfd82b05777466b97d46d376d4e11eb) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:57.092757 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ef0d21-c9c8-4492-a527-e37e2d863b7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:57.094212 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ef0d21-c9c8-4492-a527-e37e2d863b7e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:57.100908 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 344/695] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Jun 18 04:05:56 2022] GET /identity/v3/role_assignments?user.id=fbfd82b05777466b97d46d376d4e11eb&scope.project.id=9649aee8c5554102bc4193003300a3ad&role.id=f055a7ed241c4492a4f92494099bab54 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:57.194656 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c74f6e-2fea-4677-afcf-ef075a70bd22 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:57.195336 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c74f6e-2fea-4677-afcf-ef075a70bd22 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:57.195336 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c74f6e-2fea-4677-afcf-ef075a70bd22 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:57.196928 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 352/696] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:05:57.203628 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a4a9d-dfb3-4aaa-ae28-109303a38938 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:57.203628 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a4a9d-dfb3-4aaa-ae28-109303a38938 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:57.203628 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a4a9d-dfb3-4aaa-ae28-109303a38938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:57.222742 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-bb1a4a9d-dfb3-4aaa-ae28-109303a38938 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:57.224314 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-bb1a4a9d-dfb3-4aaa-ae28-109303a38938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:57.310899 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 345/697] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:05:57.330315 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c74f6e-2fea-4677-afcf-ef075a70bd22 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:57.381213 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:57.445454 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c74f6e-2fea-4677-afcf-ef075a70bd22 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:57.482186 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4d686-5d4f-4e3c-8ead-f29cd226a31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:57.482993 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4d686-5d4f-4e3c-8ead-f29cd226a31d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:57.483271 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4d686-5d4f-4e3c-8ead-f29cd226a31d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:57.483541 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4d686-5d4f-4e3c-8ead-f29cd226a31d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:57.494633 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf4d686-5d4f-4e3c-8ead-f29cd226a31d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:05:57.502533 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-7bf4d686-5d4f-4e3c-8ead-f29cd226a31d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 04:05:57.502533 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:57.502533 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:57.502533 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:57.502533 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:57.502533 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:57.502533 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:57.502533 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:57.502533 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:57.502533 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:57.502533 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:57.502533 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:57.502533 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:05:57.502533 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:05:57.502533 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:05:57.502533 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:05:57.503460 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:05:57.503460 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:05:57.503460 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:05:57.503460 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:05:57.503460 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:57.503460 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:57.503460 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:57.503460 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:57.503460 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:57.503460 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:57.503460 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:57.503460 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:57.503460 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:57.503460 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:57.503460 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:57.503460 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:57.504291 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:57.504291 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:57.504291 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:57.504291 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:57.504291 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:05:57.504291 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:05:57.504291 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:05:57.504291 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:05:57.504291 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:05:57.504291 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:05:57.504291 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 04:05:57.504291 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:57.508588 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 353/698] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Jun 18 04:05:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:57.510036 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a4a9d-dfb3-4aaa-ae28-109303a38938 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:57.512343 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:57.621611 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a4a9d-dfb3-4aaa-ae28-109303a38938 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:57.658731 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9812d721-5094-478e-a6eb-d2d3a3cffd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:57.659469 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812d721-5094-478e-a6eb-d2d3a3cffd66 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:57.659746 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812d721-5094-478e-a6eb-d2d3a3cffd66 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:57.660016 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812d721-5094-478e-a6eb-d2d3a3cffd66 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:57.660844 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9812d721-5094-478e-a6eb-d2d3a3cffd66 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:57.661150 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9812d721-5094-478e-a6eb-d2d3a3cffd66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:57.662535 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9812d721-5094-478e-a6eb-d2d3a3cffd66 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:57.672634 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 346/699] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Jun 18 04:05:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:57.678909 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4d686-5d4f-4e3c-8ead-f29cd226a31d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:57.765162 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21cb3c-d7f2-42ef-80a3-5792933d0f91 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:57.765492 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21cb3c-d7f2-42ef-80a3-5792933d0f91 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:57.765777 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21cb3c-d7f2-42ef-80a3-5792933d0f91 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:57.767173 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 347/700] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:05:57.773776 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8ce63-ffd7-4722-b0cc-7cf68884690f None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:57.774117 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8ce63-ffd7-4722-b0cc-7cf68884690f None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:57.774335 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8ce63-ffd7-4722-b0cc-7cf68884690f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:57.812143 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-4de8ce63-ffd7-4722-b0cc-7cf68884690f None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:57.814222 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-4de8ce63-ffd7-4722-b0cc-7cf68884690f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:57.817088 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4d686-5d4f-4e3c-8ead-f29cd226a31d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:57.818972 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:57.882601 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9679b8-64fb-452a-b963-e0e07e07452d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:57.883411 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9679b8-64fb-452a-b963-e0e07e07452d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:57.883687 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9679b8-64fb-452a-b963-e0e07e07452d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:57.883954 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9679b8-64fb-452a-b963-e0e07e07452d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:57.902562 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9679b8-64fb-452a-b963-e0e07e07452d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:57.906362 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9679b8-64fb-452a-b963-e0e07e07452d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:57.909280 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:57.928032 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 348/701] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:05:57.938887 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-6c9679b8-64fb-452a-b963-e0e07e07452d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:57.938887 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:57.938887 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:57.938887 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:57.938887 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:57.938887 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:57.938887 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:57.938887 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:57.938887 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:57.938887 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:57.938887 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:57.938887 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:57.938887 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:05:57.938887 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:05:57.938887 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:05:57.939853 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:05:57.939853 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:57.939853 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:57.939853 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:57.939853 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:57.939853 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:57.939853 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:57.939853 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:57.939853 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:57.939853 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:57.939853 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:57.939853 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:57.939853 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:57.939853 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:57.939853 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:57.939853 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:57.939853 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:57.940825 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:05:57.940825 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:05:57.940825 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:57.940825 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:57.947178 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 354/702] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:05:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:57.948832 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de8ce63-ffd7-4722-b0cc-7cf68884690f None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:57.965700 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9679b8-64fb-452a-b963-e0e07e07452d None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:58.104355 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9679b8-64fb-452a-b963-e0e07e07452d None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:58.144633 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60630432-580a-4e6e-b7ae-355112b15827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:58.146420 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60630432-580a-4e6e-b7ae-355112b15827 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:58.146703 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60630432-580a-4e6e-b7ae-355112b15827 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:58.146974 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60630432-580a-4e6e-b7ae-355112b15827 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:58.147635 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60630432-580a-4e6e-b7ae-355112b15827 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:58.149062 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60630432-580a-4e6e-b7ae-355112b15827 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:58.164001 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-60630432-580a-4e6e-b7ae-355112b15827 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 18 04:05:58.164001 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:58.164001 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 18 04:05:58.164001 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 18 04:05:58.164001 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 18 04:05:58.164001 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 18 04:05:58.164001 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 18 04:05:58.164001 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 04:05:58.164001 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 18 04:05:58.164001 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:58.164001 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 04:05:58.164001 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:58.164001 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:58.164001 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:58.164001 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:58.164001 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:58.165078 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:58.165078 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:58.165078 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:58.165078 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:58.165078 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:58.165078 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:58.165078 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:58.165078 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 18 04:05:58.165078 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 18 04:05:58.165078 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 18 04:05:58.165078 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 18 04:05:58.165078 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:58.165078 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:58.165078 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:58.165078 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:58.165078 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:58.165968 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:58.165968 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:58.165968 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:58.165968 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:58.165968 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:58.165968 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:58.165968 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:58.165968 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:58.165968 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:58.165968 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:58.165968 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:58.165968 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 18 04:05:58.165968 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 04:05:58.165968 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 18 04:05:58.165968 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:58.165968 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 355/703] 10.222.0.20 () {56 vars in 1129 bytes} [Sat Jun 18 04:05:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 04:05:58.174925 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60630432-580a-4e6e-b7ae-355112b15827 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:58.176370 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de8ce63-ffd7-4722-b0cc-7cf68884690f None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:58.218366 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:58.222810 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a0ac6a-70a0-442b-ae7e-f3c9473002df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:58.223504 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0ac6a-70a0-442b-ae7e-f3c9473002df None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:58.223907 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0ac6a-70a0-442b-ae7e-f3c9473002df None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:58.224203 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0ac6a-70a0-442b-ae7e-f3c9473002df None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:58.224994 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a0ac6a-70a0-442b-ae7e-f3c9473002df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:58.225299 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a0ac6a-70a0-442b-ae7e-f3c9473002df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:58.226765 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a0ac6a-70a0-442b-ae7e-f3c9473002df None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:58.263177 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 349/704] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:05:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:58.269650 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a0ac6a-70a0-442b-ae7e-f3c9473002df None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:58.322885 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60630432-580a-4e6e-b7ae-355112b15827 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:58.361676 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989d39d-57b0-40ff-8007-4d8dd29ce4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:58.362304 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989d39d-57b0-40ff-8007-4d8dd29ce4f8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:58.362583 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989d39d-57b0-40ff-8007-4d8dd29ce4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:58.362852 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989d39d-57b0-40ff-8007-4d8dd29ce4f8 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:58.363569 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f989d39d-57b0-40ff-8007-4d8dd29ce4f8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:58.364286 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f989d39d-57b0-40ff-8007-4d8dd29ce4f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:58.365888 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f989d39d-57b0-40ff-8007-4d8dd29ce4f8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:58.371280 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 356/705] 10.222.0.20 () {56 vars in 1124 bytes} [Sat Jun 18 04:05:58 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:58.377330 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989d39d-57b0-40ff-8007-4d8dd29ce4f8 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:58.402135 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:58.485460 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:58.496607 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989d39d-57b0-40ff-8007-4d8dd29ce4f8 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:58.516597 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a0ac6a-70a0-442b-ae7e-f3c9473002df None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:58.551102 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b805f7-7354-41d9-99d5-59c668e30585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:58.552011 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b805f7-7354-41d9-99d5-59c668e30585 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:58.552383 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b805f7-7354-41d9-99d5-59c668e30585 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:58.552789 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b805f7-7354-41d9-99d5-59c668e30585 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:58.557240 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad9c8f-b125-433f-bc0a-d8ded7c21481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:58.557920 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad9c8f-b125-433f-bc0a-d8ded7c21481 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:58.558199 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad9c8f-b125-433f-bc0a-d8ded7c21481 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:58.558471 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad9c8f-b125-433f-bc0a-d8ded7c21481 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:58.559183 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ad9c8f-b125-433f-bc0a-d8ded7c21481 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:58.559482 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ad9c8f-b125-433f-bc0a-d8ded7c21481 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:58.560935 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ad9c8f-b125-433f-bc0a-d8ded7c21481 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:58.561392 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b805f7-7354-41d9-99d5-59c668e30585 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:58.562907 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b805f7-7354-41d9-99d5-59c668e30585 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:58.566717 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 357/706] 10.222.0.20 () {56 vars in 1124 bytes} [Sat Jun 18 04:05:58 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:05:58.577998 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-71b805f7-7354-41d9-99d5-59c668e30585 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 18 04:05:58.577998 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:58.577998 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:58.577998 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:58.577998 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:58.577998 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:58.577998 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:58.577998 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:58.577998 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:58.577998 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:58.577998 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:58.577998 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:58.577998 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 04:05:58.577998 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 04:05:58.577998 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 04:05:58.577998 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 04:05:58.579027 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:58.579027 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:58.579027 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 04:05:58.579027 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 04:05:58.579027 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 04:05:58.579027 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 04:05:58.579027 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:58.579027 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:58.579027 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:58.579027 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:58.579027 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:58.579027 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:58.579027 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:58.579027 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:58.579027 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:58.579027 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:58.579027 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:58.579027 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:58.580238 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:58.580238 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:58.580238 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 04:05:58.580238 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 04:05:58.580238 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 04:05:58.580238 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 04:05:58.580238 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 04:05:58.580238 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 04:05:58.580238 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 18 04:05:58.580238 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:05:58.580238 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 350/707] 10.222.0.20 () {56 vars in 1093 bytes} [Sat Jun 18 04:05:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:58.586834 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad9c8f-b125-433f-bc0a-d8ded7c21481 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:58.752527 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad9c8f-b125-433f-bc0a-d8ded7c21481 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:58.800048 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53737029-9169-4133-83a9-694aa2618c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:58.800763 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53737029-9169-4133-83a9-694aa2618c52 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:58.801047 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53737029-9169-4133-83a9-694aa2618c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:58.801321 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53737029-9169-4133-83a9-694aa2618c52 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:58.802169 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53737029-9169-4133-83a9-694aa2618c52 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:58.802476 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53737029-9169-4133-83a9-694aa2618c52 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:58.803914 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53737029-9169-4133-83a9-694aa2618c52 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:58.828902 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 358/708] 10.222.0.20 () {56 vars in 1133 bytes} [Sat Jun 18 04:05:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:58.834565 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b805f7-7354-41d9-99d5-59c668e30585 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:58.960474 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9159288d-e7d0-4e2d-b125-1558886a3b55 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:58.960877 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9159288d-e7d0-4e2d-b125-1558886a3b55 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:58.961098 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9159288d-e7d0-4e2d-b125-1558886a3b55 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:58.964726 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 359/709] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 18 04:05:58.968003 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851c7ef-469a-4cf5-8f06-6b4aab0cf8cc None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:58.968308 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851c7ef-469a-4cf5-8f06-6b4aab0cf8cc None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:58.968552 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851c7ef-469a-4cf5-8f06-6b4aab0cf8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:58.974804 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:58.981704 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b805f7-7354-41d9-99d5-59c668e30585 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:58.987012 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-e851c7ef-469a-4cf5-8f06-6b4aab0cf8cc None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:58.988229 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e851c7ef-469a-4cf5-8f06-6b4aab0cf8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:59.005114 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:59.043851 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4194352-2041-4c15-8cb0-84ed8c29fa91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:59.044513 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4194352-2041-4c15-8cb0-84ed8c29fa91 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:59.044820 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4194352-2041-4c15-8cb0-84ed8c29fa91 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:59.045190 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4194352-2041-4c15-8cb0-84ed8c29fa91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:59.059511 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 360/710] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 18 04:05:59.082788 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851c7ef-469a-4cf5-8f06-6b4aab0cf8cc None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:59.157220 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4194352-2041-4c15-8cb0-84ed8c29fa91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:59.158700 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4194352-2041-4c15-8cb0-84ed8c29fa91 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:59.189610 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851c7ef-469a-4cf5-8f06-6b4aab0cf8cc None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:59.226655 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b46954f-1758-429c-b034-150b3d725351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:59.227469 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46954f-1758-429c-b034-150b3d725351 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:59.227777 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46954f-1758-429c-b034-150b3d725351 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:59.228062 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46954f-1758-429c-b034-150b3d725351 None admin] PATH_INFO: `/v3/services/network` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:59.228760 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b46954f-1758-429c-b034-150b3d725351 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:59.230142 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b46954f-1758-429c-b034-150b3d725351 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:59.242655 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-0b46954f-1758-429c-b034-150b3d725351 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 18 04:05:59.242655 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:59.242655 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 18 04:05:59.242655 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 18 04:05:59.242655 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 18 04:05:59.242655 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 18 04:05:59.242655 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 18 04:05:59.242655 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 04:05:59.242655 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 18 04:05:59.242655 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:59.242655 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 04:05:59.242655 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:59.242655 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:59.242655 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:59.242655 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:59.242655 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:59.242655 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:59.243708 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:59.243708 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:59.243708 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:59.243708 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:59.243708 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:59.243708 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:59.243708 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 18 04:05:59.243708 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 18 04:05:59.243708 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 18 04:05:59.243708 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 18 04:05:59.243708 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:59.243708 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:59.243708 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:59.243708 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:59.243708 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:59.243708 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:59.244530 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:59.244530 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:59.244530 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:59.244530 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:59.244530 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:59.244530 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:59.244530 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:59.244530 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:59.244530 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:59.244530 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:59.244530 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 18 04:05:59.244530 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 04:05:59.244530 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 18 04:05:59.244530 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:59.244530 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 361/711] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Jun 18 04:05:59 2022] GET /identity/v3/services/network => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 04:05:59.248804 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:59.249627 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023be162-9074-4747-b084-a83afafde556 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:59.250019 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023be162-9074-4747-b084-a83afafde556 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:59.250473 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023be162-9074-4747-b084-a83afafde556 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:59.252593 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 362/712] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:05:59.253673 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023be162-9074-4747-b084-a83afafde556 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:59.283591 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 351/713] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Jun 18 04:05:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 04:05:59.285487 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b419c0-c1ac-4bd2-9859-30990467f564 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:59.285895 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b419c0-c1ac-4bd2-9859-30990467f564 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:59.286312 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b419c0-c1ac-4bd2-9859-30990467f564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:59.309624 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-c5b419c0-c1ac-4bd2-9859-30990467f564 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:05:59.310825 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c5b419c0-c1ac-4bd2-9859-30990467f564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:05:59.320866 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:59.373084 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023be162-9074-4747-b084-a83afafde556 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:59.382329 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 352/714] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:05:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:05:59.383394 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b419c0-c1ac-4bd2-9859-30990467f564 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:59.409925 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d940ccc6-b550-4300-bf94-56ee0e8e8e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:59.410693 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940ccc6-b550-4300-bf94-56ee0e8e8e08 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:59.411074 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940ccc6-b550-4300-bf94-56ee0e8e8e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:59.411461 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940ccc6-b550-4300-bf94-56ee0e8e8e08 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:59.412259 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d940ccc6-b550-4300-bf94-56ee0e8e8e08 None admin] RBAC: Adding query filter params (name=network) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:59.412650 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d940ccc6-b550-4300-bf94-56ee0e8e8e08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:59.414122 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d940ccc6-b550-4300-bf94-56ee0e8e8e08 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:59.423317 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 363/715] 10.222.0.20 () {56 vars in 1112 bytes} [Sat Jun 18 04:05:59 2022] GET /identity/v3/services?name=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:59.423317 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d940ccc6-b550-4300-bf94-56ee0e8e8e08 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:59.483473 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:59.500608 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b419c0-c1ac-4bd2-9859-30990467f564 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:59.525526 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d940ccc6-b550-4300-bf94-56ee0e8e8e08 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:59.536426 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f0df76-d181-442b-8f1a-77a8a3da4878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:59.537827 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0df76-d181-442b-8f1a-77a8a3da4878 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:59.538175 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0df76-d181-442b-8f1a-77a8a3da4878 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:59.538517 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0df76-d181-442b-8f1a-77a8a3da4878 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:59.551035 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f0df76-d181-442b-8f1a-77a8a3da4878 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:59.553262 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f0df76-d181-442b-8f1a-77a8a3da4878 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:59.563042 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da98ed-d56d-48d9-bb09-3b71e268f3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:59.563940 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da98ed-d56d-48d9-bb09-3b71e268f3b8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:59.564284 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da98ed-d56d-48d9-bb09-3b71e268f3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:59.564756 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:59.565056 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da98ed-d56d-48d9-bb09-3b71e268f3b8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:59.575940 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-f0f0df76-d181-442b-8f1a-77a8a3da4878 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:59.575940 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:59.575940 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:59.575940 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:59.575940 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:59.575940 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:59.575940 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:59.575940 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:59.575940 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:59.575940 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:59.575940 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:59.575940 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:59.575940 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:05:59.575940 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:05:59.575940 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:05:59.578006 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:05:59.578006 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:59.578006 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:59.578006 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:59.578006 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:59.578006 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:59.578006 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:59.578006 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:59.578006 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:59.578006 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:59.578006 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:59.578006 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:59.578006 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:59.578006 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:59.578006 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:59.578006 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:59.578006 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:59.579105 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:05:59.579105 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:05:59.579105 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:05:59.579105 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:05:59.579348 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89da98ed-d56d-48d9-bb09-3b71e268f3b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:05:59.583444 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 353/716] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:05:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:59.584389 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f0df76-d181-442b-8f1a-77a8a3da4878 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:59.589358 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-89da98ed-d56d-48d9-bb09-3b71e268f3b8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 18 04:05:59.589358 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:59.589358 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:59.589358 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:59.589358 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:59.589358 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:59.589358 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:59.589358 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:59.589358 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:59.589358 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:59.589358 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:59.589358 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:59.589358 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:05:59.589358 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:05:59.589358 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:05:59.589358 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:05:59.590259 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:05:59.590259 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:05:59.590259 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:05:59.590259 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:05:59.590259 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:59.590259 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:59.590259 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:59.590259 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:59.590259 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:59.590259 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:59.590259 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:59.590259 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:59.590259 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:59.590259 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:59.590259 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:59.590259 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:59.591104 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:59.591104 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:59.591104 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:59.591104 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:59.591104 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:05:59.591104 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:05:59.591104 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:05:59.591104 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:05:59.591104 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:05:59.591104 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:05:59.591104 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 18 04:05:59.591104 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:59.591104 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 364/717] 10.222.0.20 () {56 vars in 1102 bytes} [Sat Jun 18 04:05:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:59.591787 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da98ed-d56d-48d9-bb09-3b71e268f3b8 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:59.700956 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f0df76-d181-442b-8f1a-77a8a3da4878 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:59.706123 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da98ed-d56d-48d9-bb09-3b71e268f3b8 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:59.729379 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:59.739549 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc033b7-dba9-4fc7-a3f3-5246f6a7b69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:59.741043 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc033b7-dba9-4fc7-a3f3-5246f6a7b69f None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:59.741372 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc033b7-dba9-4fc7-a3f3-5246f6a7b69f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:59.741637 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc033b7-dba9-4fc7-a3f3-5246f6a7b69f None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:59.742438 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc033b7-dba9-4fc7-a3f3-5246f6a7b69f None admin] RBAC: Adding query filter params (type=network) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:59.742693 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e56de-3a9f-4366-89fb-fa52edc4b99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:59.742844 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc033b7-dba9-4fc7-a3f3-5246f6a7b69f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:59.743527 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e56de-3a9f-4366-89fb-fa52edc4b99a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:59.743870 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e56de-3a9f-4366-89fb-fa52edc4b99a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:59.744198 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc033b7-dba9-4fc7-a3f3-5246f6a7b69f None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:59.744336 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e56de-3a9f-4366-89fb-fa52edc4b99a None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:59.745072 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e56de-3a9f-4366-89fb-fa52edc4b99a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:59.745443 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e56de-3a9f-4366-89fb-fa52edc4b99a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:59.746862 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e56de-3a9f-4366-89fb-fa52edc4b99a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:59.750663 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 354/718] 10.222.0.20 () {56 vars in 1112 bytes} [Sat Jun 18 04:05:59 2022] GET /identity/v3/services?type=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:59.751534 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc033b7-dba9-4fc7-a3f3-5246f6a7b69f None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:59.766313 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 365/719] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:05:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:59.767919 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e56de-3a9f-4366-89fb-fa52edc4b99a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:59.823773 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:05:59.871887 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc033b7-dba9-4fc7-a3f3-5246f6a7b69f None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:59.876655 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e56de-3a9f-4366-89fb-fa52edc4b99a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:05:59.910518 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107795e-1347-4ef9-a4d4-dc341893d77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:59.911432 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107795e-1347-4ef9-a4d4-dc341893d77f None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:59.911707 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107795e-1347-4ef9-a4d4-dc341893d77f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:59.912050 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107795e-1347-4ef9-a4d4-dc341893d77f None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:59.912842 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e107795e-1347-4ef9-a4d4-dc341893d77f None admin] RBAC: Adding query filter params (name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:05:59.913143 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e107795e-1347-4ef9-a4d4-dc341893d77f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:59.914033 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ac484a-03db-49fb-ad89-7f02b2b376f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:05:59.914670 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e107795e-1347-4ef9-a4d4-dc341893d77f None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:59.914962 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac484a-03db-49fb-ad89-7f02b2b376f1 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:59.915364 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac484a-03db-49fb-ad89-7f02b2b376f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:59.915703 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac484a-03db-49fb-ad89-7f02b2b376f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:59.923162 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ac484a-03db-49fb-ad89-7f02b2b376f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:05:59.924359 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 355/720] 10.222.0.20 () {56 vars in 1103 bytes} [Sat Jun 18 04:05:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:05:59.924889 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ac484a-03db-49fb-ad89-7f02b2b376f1 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:05:59.929745 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107795e-1347-4ef9-a4d4-dc341893d77f None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:05:59.957004 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-a9ac484a-03db-49fb-ad89-7f02b2b376f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 04:05:59.957004 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:05:59.957004 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:05:59.957004 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:05:59.957004 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:05:59.957004 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:05:59.957004 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:05:59.957004 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:05:59.957004 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:05:59.957004 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:05:59.957004 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:05:59.957004 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:05:59.957004 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 04:05:59.957004 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 04:05:59.957004 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 04:05:59.959066 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 04:05:59.959066 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:05:59.959066 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:05:59.959066 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:05:59.959066 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:05:59.959066 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:05:59.959066 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:05:59.959066 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:05:59.959066 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:05:59.959066 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:05:59.959066 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:05:59.959066 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:05:59.959066 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:05:59.959066 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:05:59.959066 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:05:59.959066 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:05:59.959066 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:05:59.961161 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 04:05:59.961161 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 04:05:59.961161 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 04:05:59.961161 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 04:05:59.961161 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 04:05:59.961161 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 04:05:59.961161 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 04:05:59.961161 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:05:59.961161 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 366/721] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Jun 18 04:05:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:05:59.961161 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8701754-3738-4920-a058-56f019655854 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:05:59.961161 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8701754-3738-4920-a058-56f019655854 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:05:59.962636 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8701754-3738-4920-a058-56f019655854 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:05:59.962636 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 367/722] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:05:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:05:59.969722 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8701754-3738-4920-a058-56f019655854 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:00.032427 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:00.073919 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107795e-1347-4ef9-a4d4-dc341893d77f None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:00.100070 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:00.115565 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9136f-4798-413e-8809-ac29968dcd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:00.115961 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8701754-3738-4920-a058-56f019655854 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:00.116919 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9136f-4798-413e-8809-ac29968dcd87 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:00.117379 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9136f-4798-413e-8809-ac29968dcd87 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:00.117856 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9136f-4798-413e-8809-ac29968dcd87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:00.129706 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b9136f-4798-413e-8809-ac29968dcd87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:00.131459 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b9136f-4798-413e-8809-ac29968dcd87 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:00.149457 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-09b9136f-4798-413e-8809-ac29968dcd87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:06:00.149457 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:00.149457 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:00.149457 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:00.149457 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:00.149457 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:00.149457 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:00.149457 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:00.149457 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:00.149457 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:00.149457 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:00.149457 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:00.149457 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:06:00.149457 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:06:00.149457 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:06:00.150494 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:06:00.150494 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:00.150494 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:00.150494 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:00.150494 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:00.150494 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:00.150494 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:00.150494 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:00.150494 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:00.150494 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:00.150494 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:00.150494 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:00.150494 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:00.150494 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:00.150494 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:00.150494 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:00.150494 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:00.151462 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:06:00.151462 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:06:00.151462 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:06:00.151462 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:00.153806 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 356/723] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:05:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 04:06:00.155296 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e089c-c300-4233-a8bc-c49e2be4a59a None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:00.155760 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e089c-c300-4233-a8bc-c49e2be4a59a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:00.156209 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e089c-c300-4233-a8bc-c49e2be4a59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:00.159931 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339867aa-b4de-4ade-8211-8bac74211278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:00.160628 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339867aa-b4de-4ade-8211-8bac74211278 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:00.160948 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339867aa-b4de-4ade-8211-8bac74211278 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:00.161263 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339867aa-b4de-4ade-8211-8bac74211278 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:00.162064 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339867aa-b4de-4ade-8211-8bac74211278 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:00.162372 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339867aa-b4de-4ade-8211-8bac74211278 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:00.164693 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339867aa-b4de-4ade-8211-8bac74211278 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:00.179768 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-cc3e089c-c300-4233-a8bc-c49e2be4a59a None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:06:00.181061 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-cc3e089c-c300-4233-a8bc-c49e2be4a59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:06:00.186874 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 368/724] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Jun 18 04:05:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:00.188130 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339867aa-b4de-4ade-8211-8bac74211278 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:00.269790 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 357/725] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:06:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:06:00.270695 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e089c-c300-4233-a8bc-c49e2be4a59a None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:00.294308 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339867aa-b4de-4ade-8211-8bac74211278 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:00.299618 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:00.337837 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb20ca-8bc9-4e56-86dd-51f368d44428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:00.338936 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb20ca-8bc9-4e56-86dd-51f368d44428 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:00.339399 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb20ca-8bc9-4e56-86dd-51f368d44428 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:00.339847 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb20ca-8bc9-4e56-86dd-51f368d44428 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:00.340798 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bb20ca-8bc9-4e56-86dd-51f368d44428 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:00.341419 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bb20ca-8bc9-4e56-86dd-51f368d44428 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:00.343104 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bb20ca-8bc9-4e56-86dd-51f368d44428 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:00.355906 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 369/726] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:06:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:00.357150 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb20ca-8bc9-4e56-86dd-51f368d44428 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:00.405452 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e089c-c300-4233-a8bc-c49e2be4a59a None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:00.408685 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:00.444529 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107be037-173f-4efa-a35e-07cb5a91b0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:00.445530 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107be037-173f-4efa-a35e-07cb5a91b0b7 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:00.446014 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107be037-173f-4efa-a35e-07cb5a91b0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:00.446591 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107be037-173f-4efa-a35e-07cb5a91b0b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:00.447654 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107be037-173f-4efa-a35e-07cb5a91b0b7 None admin] RBAC: Adding query filter params (role.id=d783a633c75847d48ef7ef5b169b0313, scope.project.id=9649aee8c5554102bc4193003300a3ad, user.id=c129f3de2bb2431593fac649fd4975b3) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:00.448155 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107be037-173f-4efa-a35e-07cb5a91b0b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:00.449808 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107be037-173f-4efa-a35e-07cb5a91b0b7 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:00.464746 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 358/727] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Jun 18 04:06:00 2022] GET /identity/v3/role_assignments?user.id=c129f3de2bb2431593fac649fd4975b3&scope.project.id=9649aee8c5554102bc4193003300a3ad&role.id=d783a633c75847d48ef7ef5b169b0313 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:00.466073 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107be037-173f-4efa-a35e-07cb5a91b0b7 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:00.466214 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb20ca-8bc9-4e56-86dd-51f368d44428 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:00.503294 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b4d54b-e78b-488c-b19e-52e9553a227a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:00.504107 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4d54b-e78b-488c-b19e-52e9553a227a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:00.504385 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4d54b-e78b-488c-b19e-52e9553a227a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:00.504684 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4d54b-e78b-488c-b19e-52e9553a227a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:00.516683 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b4d54b-e78b-488c-b19e-52e9553a227a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:06:00.524453 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-c3b4d54b-e78b-488c-b19e-52e9553a227a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 04:06:00.524453 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:00.524453 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:00.524453 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:00.524453 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:00.524453 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:00.524453 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:00.524453 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:00.524453 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:00.524453 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:00.524453 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:00.524453 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:00.524453 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:06:00.524453 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:06:00.524453 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:06:00.524453 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:06:00.525559 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:06:00.525559 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:06:00.525559 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:06:00.525559 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:06:00.525559 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:00.525559 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:00.525559 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:00.525559 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:00.525559 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:00.525559 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:00.525559 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:00.525559 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:00.525559 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:00.525559 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:00.525559 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:00.525559 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:00.531797 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:00.531797 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:00.531797 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:00.531797 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:00.531797 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:06:00.531797 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:06:00.531797 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:06:00.531797 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:06:00.531797 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:06:00.531797 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:06:00.531797 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 04:06:00.531797 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:00.531797 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 370/728] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Jun 18 04:06:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:00.532494 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b4d54b-e78b-488c-b19e-52e9553a227a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:00.567066 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:00.640515 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107be037-173f-4efa-a35e-07cb5a91b0b7 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:00.652219 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b4d54b-e78b-488c-b19e-52e9553a227a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:00.686517 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10440a8-28e0-4f5b-b1fb-98a76dd1ad9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:00.687367 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10440a8-28e0-4f5b-b1fb-98a76dd1ad9b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:00.687697 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10440a8-28e0-4f5b-b1fb-98a76dd1ad9b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:00.687970 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10440a8-28e0-4f5b-b1fb-98a76dd1ad9b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:00.697431 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10440a8-28e0-4f5b-b1fb-98a76dd1ad9b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:00.701073 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10440a8-28e0-4f5b-b1fb-98a76dd1ad9b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:00.704675 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914b1cfe-e18f-4af8-a561-c71ad09febce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:00.705665 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b1cfe-e18f-4af8-a561-c71ad09febce None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:00.706128 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b1cfe-e18f-4af8-a561-c71ad09febce None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:00.706573 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b1cfe-e18f-4af8-a561-c71ad09febce None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:00.707531 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914b1cfe-e18f-4af8-a561-c71ad09febce None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:00.709003 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914b1cfe-e18f-4af8-a561-c71ad09febce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:00.710651 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914b1cfe-e18f-4af8-a561-c71ad09febce None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:00.729327 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-c10440a8-28e0-4f5b-b1fb-98a76dd1ad9b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 18 04:06:00.729327 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:00.729327 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:00.729327 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:00.729327 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:00.729327 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:00.729327 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:00.729327 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:00.729327 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:00.729327 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:00.729327 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:00.729327 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:00.729327 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 04:06:00.729327 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 04:06:00.729327 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 04:06:00.729327 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 04:06:00.730316 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:00.730316 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:00.730316 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 04:06:00.730316 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 04:06:00.730316 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 04:06:00.730316 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 04:06:00.730316 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:00.730316 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:00.730316 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:00.730316 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:00.730316 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:00.730316 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:00.730316 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:00.730316 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:00.730316 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:00.730316 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:00.730316 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:00.730316 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:00.731620 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:00.731620 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:00.731620 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 04:06:00.731620 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 04:06:00.731620 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 04:06:00.731620 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 04:06:00.731620 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 04:06:00.731620 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 04:06:00.731620 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 18 04:06:00.731620 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:00.737489 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 371/729] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Jun 18 04:06:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:06:00.739319 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 359/730] 10.222.0.20 () {56 vars in 1117 bytes} [Sat Jun 18 04:06:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:00.745712 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914b1cfe-e18f-4af8-a561-c71ad09febce None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:00.748763 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10440a8-28e0-4f5b-b1fb-98a76dd1ad9b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:00.810705 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:00.841033 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:00.857708 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914b1cfe-e18f-4af8-a561-c71ad09febce None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:00.893067 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0782725-0dd2-4541-b2df-1807b366367e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:00.894128 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0782725-0dd2-4541-b2df-1807b366367e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:00.894558 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0782725-0dd2-4541-b2df-1807b366367e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:00.894971 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0782725-0dd2-4541-b2df-1807b366367e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:00.906191 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0782725-0dd2-4541-b2df-1807b366367e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:00.907838 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0782725-0dd2-4541-b2df-1807b366367e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:00.927506 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-d0782725-0dd2-4541-b2df-1807b366367e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:06:00.927506 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:00.927506 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:00.927506 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:00.927506 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:00.927506 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:00.927506 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:00.927506 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:00.927506 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:00.927506 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:00.927506 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:00.927506 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:00.927506 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:06:00.927506 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:06:00.927506 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:06:00.928627 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:06:00.928627 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:00.928627 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:00.928627 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:00.928627 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:00.928627 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:00.928627 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:00.928627 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:00.928627 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:00.928627 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:00.928627 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:00.928627 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:00.928627 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:00.928627 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:00.928627 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:00.928627 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:00.928627 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:00.929745 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:06:00.929745 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:06:00.929745 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:06:00.929745 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:00.931651 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 372/731] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:06:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:00.938032 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0782725-0dd2-4541-b2df-1807b366367e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:00.977040 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10440a8-28e0-4f5b-b1fb-98a76dd1ad9b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:01.049743 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4986974-e6d5-4776-8619-5a0e428b3772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:01.050715 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4986974-e6d5-4776-8619-5a0e428b3772 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:01.051321 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4986974-e6d5-4776-8619-5a0e428b3772 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:01.052009 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4986974-e6d5-4776-8619-5a0e428b3772 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:01.053754 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4986974-e6d5-4776-8619-5a0e428b3772 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:01.056449 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4986974-e6d5-4776-8619-5a0e428b3772 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:01.059136 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4986974-e6d5-4776-8619-5a0e428b3772 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:01.104930 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 360/732] 10.222.0.20 () {56 vars in 1149 bytes} [Sat Jun 18 04:06:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:01.121185 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4986974-e6d5-4776-8619-5a0e428b3772 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:01.129045 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0782725-0dd2-4541-b2df-1807b366367e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:01.172196 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec18b2-8c31-4fde-8576-792e738195ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:01.173071 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec18b2-8c31-4fde-8576-792e738195ad None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:01.173353 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec18b2-8c31-4fde-8576-792e738195ad None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:01.173626 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec18b2-8c31-4fde-8576-792e738195ad None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:01.174779 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ec18b2-8c31-4fde-8576-792e738195ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:01.175091 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ec18b2-8c31-4fde-8576-792e738195ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:01.176997 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ec18b2-8c31-4fde-8576-792e738195ad None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:01.180226 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:01.196707 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 373/733] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:06:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:06:01.198405 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad5e4a-3813-4d9e-a614-e197f76ee613 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:01.198860 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad5e4a-3813-4d9e-a614-e197f76ee613 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:01.199302 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad5e4a-3813-4d9e-a614-e197f76ee613 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:01.201025 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 374/734] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:06:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:06:01.201879 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad5e4a-3813-4d9e-a614-e197f76ee613 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:01.249063 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:01.267510 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4986974-e6d5-4776-8619-5a0e428b3772 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:01.304256 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad5e4a-3813-4d9e-a614-e197f76ee613 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:01.305457 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdde91d-d110-4277-bfb6-53f54c8f8ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:01.306459 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdde91d-d110-4277-bfb6-53f54c8f8ee2 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:01.306997 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdde91d-d110-4277-bfb6-53f54c8f8ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:01.307490 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdde91d-d110-4277-bfb6-53f54c8f8ee2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:01.340086 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888d399b-5be6-4d48-a8d0-f86629495efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:01.340914 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d399b-5be6-4d48-a8d0-f86629495efd None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:01.341193 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d399b-5be6-4d48-a8d0-f86629495efd None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:01.341450 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d399b-5be6-4d48-a8d0-f86629495efd None admin] PATH_INFO: `/v3/users/swift` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:01.348715 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888d399b-5be6-4d48-a8d0-f86629495efd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:01.350170 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888d399b-5be6-4d48-a8d0-f86629495efd None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:01.365867 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-888d399b-5be6-4d48-a8d0-f86629495efd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 18 04:06:01.365867 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:01.365867 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:01.365867 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:01.365867 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:01.365867 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:01.365867 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:01.365867 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:01.365867 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:01.365867 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:01.365867 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:01.365867 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:01.365867 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 04:06:01.365867 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 04:06:01.365867 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 04:06:01.365867 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 04:06:01.366920 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:01.366920 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:01.366920 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 04:06:01.366920 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 04:06:01.366920 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 04:06:01.366920 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 04:06:01.366920 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:01.366920 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:01.366920 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:01.366920 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:01.366920 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:01.366920 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:01.366920 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:01.366920 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:01.366920 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:01.366920 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:01.366920 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:01.366920 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:01.368426 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:01.368426 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:01.368426 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 04:06:01.368426 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 04:06:01.368426 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 04:06:01.368426 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 04:06:01.368426 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 04:06:01.368426 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 04:06:01.368426 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 18 04:06:01.368426 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:01.371881 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 375/735] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Jun 18 04:06:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:01.373203 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62db94-55f0-478a-9319-0a61f6a2d753 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:01.373486 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62db94-55f0-478a-9319-0a61f6a2d753 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:01.373760 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62db94-55f0-478a-9319-0a61f6a2d753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:01.390467 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-5c62db94-55f0-478a-9319-0a61f6a2d753 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:06:01.390707 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdde91d-d110-4277-bfb6-53f54c8f8ee2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:01.391846 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-5c62db94-55f0-478a-9319-0a61f6a2d753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:06:01.392502 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdde91d-d110-4277-bfb6-53f54c8f8ee2 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:01.443868 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:01.462579 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 376/736] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:06:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:06:01.462579 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c62db94-55f0-478a-9319-0a61f6a2d753 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:01.508117 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:01.533674 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 361/737] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Jun 18 04:06:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 18 04:06:01.534821 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdde91d-d110-4277-bfb6-53f54c8f8ee2 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:01.565784 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c62db94-55f0-478a-9319-0a61f6a2d753 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:01.600264 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd6801-c6f9-471b-bf76-09bb3a5c4bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:01.600983 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd6801-c6f9-471b-bf76-09bb3a5c4bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:01.601264 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd6801-c6f9-471b-bf76-09bb3a5c4bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:01.601534 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd6801-c6f9-471b-bf76-09bb3a5c4bd3 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:01.602374 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bd6801-c6f9-471b-bf76-09bb3a5c4bd3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:01.602758 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bd6801-c6f9-471b-bf76-09bb3a5c4bd3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:01.604147 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bd6801-c6f9-471b-bf76-09bb3a5c4bd3 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:01.622486 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 377/738] 10.222.0.20 () {56 vars in 1135 bytes} [Sat Jun 18 04:06:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:01.623340 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd6801-c6f9-471b-bf76-09bb3a5c4bd3 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:01.646247 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdde91d-d110-4277-bfb6-53f54c8f8ee2 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:01.676173 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:01.689975 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178241c-ab75-4f97-b4f2-50e654bc6e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:01.690998 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178241c-ab75-4f97-b4f2-50e654bc6e83 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:01.691421 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178241c-ab75-4f97-b4f2-50e654bc6e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:01.691835 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178241c-ab75-4f97-b4f2-50e654bc6e83 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:01.692881 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6178241c-ab75-4f97-b4f2-50e654bc6e83 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:01.694548 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6178241c-ab75-4f97-b4f2-50e654bc6e83 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:01.714137 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 362/739] 10.222.0.20 () {60 vars in 1141 bytes} [Sat Jun 18 04:06:01 2022] POST /identity/v3/services => generated 251 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 04:06:01.722234 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178241c-ab75-4f97-b4f2-50e654bc6e83 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:01.732322 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd6801-c6f9-471b-bf76-09bb3a5c4bd3 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:01.786723 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:01.837476 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b5713-c57d-46d1-9416-06f4edb83a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:01.838394 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b5713-c57d-46d1-9416-06f4edb83a8a None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:01.838671 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b5713-c57d-46d1-9416-06f4edb83a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:01.838956 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b5713-c57d-46d1-9416-06f4edb83a8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:01.860312 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178241c-ab75-4f97-b4f2-50e654bc6e83 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:01.863904 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0b5713-c57d-46d1-9416-06f4edb83a8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:01.864870 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0b5713-c57d-46d1-9416-06f4edb83a8a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:01.893199 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-cb0b5713-c57d-46d1-9416-06f4edb83a8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:06:01.893199 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:01.893199 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:01.893199 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:01.893199 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:01.893199 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:01.893199 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:01.893199 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:01.893199 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:01.893199 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:01.893199 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:01.893199 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:01.893199 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:06:01.893199 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:06:01.893199 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:06:01.894159 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:06:01.894159 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:01.894159 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:01.894159 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:01.894159 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:01.894159 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:01.894159 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:01.894159 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:01.894159 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:01.894159 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:01.894159 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:01.894159 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:01.894159 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:01.894159 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:01.894159 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:01.894159 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:01.894159 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:01.895058 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:06:01.895058 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:06:01.895058 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:06:01.895058 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:01.901481 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 378/740] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:06:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:01.902722 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b5713-c57d-46d1-9416-06f4edb83a8a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:01.907887 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee56c2-b6c8-4f18-8b10-d261e6a11eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:01.908907 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee56c2-b6c8-4f18-8b10-d261e6a11eb3 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:01.909378 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee56c2-b6c8-4f18-8b10-d261e6a11eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:01.910129 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee56c2-b6c8-4f18-8b10-d261e6a11eb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:02.019273 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:02.030849 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b5713-c57d-46d1-9416-06f4edb83a8a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:02.043830 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ee56c2-b6c8-4f18-8b10-d261e6a11eb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:02.045344 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ee56c2-b6c8-4f18-8b10-d261e6a11eb3 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:02.069701 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab8d048-447f-4950-aa0d-15f2b21b145f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:02.070369 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8d048-447f-4950-aa0d-15f2b21b145f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:02.070645 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8d048-447f-4950-aa0d-15f2b21b145f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:02.071337 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8d048-447f-4950-aa0d-15f2b21b145f None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:02.072109 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab8d048-447f-4950-aa0d-15f2b21b145f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:02.073175 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab8d048-447f-4950-aa0d-15f2b21b145f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:02.074556 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab8d048-447f-4950-aa0d-15f2b21b145f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:02.089405 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 379/741] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:06:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:02.090744 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5c92e-8818-45e2-af34-17cf461d09c3 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:02.091014 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5c92e-8818-45e2-af34-17cf461d09c3 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:02.091550 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5c92e-8818-45e2-af34-17cf461d09c3 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:02.097003 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 380/742] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:06:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:06:02.097791 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef5c92e-8818-45e2-af34-17cf461d09c3 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:02.102932 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:02.163413 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 363/743] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Jun 18 04:06:01 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 04:06:02.165726 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c2e10-67c7-4015-8ecf-3be89b485c0a None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:02.166281 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c2e10-67c7-4015-8ecf-3be89b485c0a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:02.166775 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c2e10-67c7-4015-8ecf-3be89b485c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:02.184813 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-807c2e10-67c7-4015-8ecf-3be89b485c0a None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:06:02.186022 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-807c2e10-67c7-4015-8ecf-3be89b485c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:06:02.234603 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef5c92e-8818-45e2-af34-17cf461d09c3 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:02.268605 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 364/744] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:06:02 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 04:06:02.268605 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c2e10-67c7-4015-8ecf-3be89b485c0a None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:02.300638 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b24d5a-e2a0-4197-a1af-f5b859b09039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:02.301433 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b24d5a-e2a0-4197-a1af-f5b859b09039 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:02.301703 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b24d5a-e2a0-4197-a1af-f5b859b09039 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:02.301970 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b24d5a-e2a0-4197-a1af-f5b859b09039 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:02.309289 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b24d5a-e2a0-4197-a1af-f5b859b09039 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:02.310622 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b24d5a-e2a0-4197-a1af-f5b859b09039 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:02.325144 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-d7b24d5a-e2a0-4197-a1af-f5b859b09039 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 04:06:02.325144 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:02.325144 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:02.325144 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:02.325144 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:02.325144 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:02.325144 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:02.325144 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:02.325144 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:02.325144 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:02.325144 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:02.325144 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:02.325144 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 04:06:02.325144 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 04:06:02.325144 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 04:06:02.326071 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 04:06:02.326071 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:02.326071 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:02.326071 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:02.326071 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:02.326071 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:02.326071 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:02.326071 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:02.326071 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:02.326071 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:02.326071 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:02.326071 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:02.326071 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:02.326071 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:02.326071 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:02.326071 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:02.326071 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:02.326930 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 04:06:02.326930 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 04:06:02.326930 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 04:06:02.326930 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 04:06:02.326930 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 04:06:02.326930 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 04:06:02.326930 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 04:06:02.326930 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:02.326930 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 381/745] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Jun 18 04:06:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:02.327851 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b24d5a-e2a0-4197-a1af-f5b859b09039 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:02.344411 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:02.380780 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:02.408851 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c2e10-67c7-4015-8ecf-3be89b485c0a None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:02.434724 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b24d5a-e2a0-4197-a1af-f5b859b09039 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:02.451791 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab679511-8aef-47f3-98a2-e112524ed510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:02.452890 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab679511-8aef-47f3-98a2-e112524ed510 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:02.453173 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab679511-8aef-47f3-98a2-e112524ed510 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:02.453445 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab679511-8aef-47f3-98a2-e112524ed510 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:02.466813 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab679511-8aef-47f3-98a2-e112524ed510 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:02.469398 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab679511-8aef-47f3-98a2-e112524ed510 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:02.470694 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792ffd4-f7a6-43a4-aa7e-f3fa4bb913b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:02.471674 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792ffd4-f7a6-43a4-aa7e-f3fa4bb913b1 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:02.472160 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792ffd4-f7a6-43a4-aa7e-f3fa4bb913b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:02.472664 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792ffd4-f7a6-43a4-aa7e-f3fa4bb913b1 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:02.473701 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2792ffd4-f7a6-43a4-aa7e-f3fa4bb913b1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:02.475273 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2792ffd4-f7a6-43a4-aa7e-f3fa4bb913b1 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:02.494599 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 382/746] 10.222.0.20 () {60 vars in 1141 bytes} [Sat Jun 18 04:06:02 2022] POST /identity/v3/services => generated 240 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 04:06:02.495926 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792ffd4-f7a6-43a4-aa7e-f3fa4bb913b1 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:02.503217 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-ab679511-8aef-47f3-98a2-e112524ed510 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:06:02.503217 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:02.503217 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:02.503217 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:02.503217 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:02.503217 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:02.503217 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:02.503217 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:02.503217 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:02.503217 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:02.503217 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:02.503217 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:02.503217 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:06:02.503217 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:06:02.503217 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:06:02.504185 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:06:02.504185 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:02.504185 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:02.504185 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:02.504185 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:02.504185 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:02.504185 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:02.504185 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:02.504185 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:02.504185 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:02.504185 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:02.504185 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:02.504185 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:02.504185 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:02.504185 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:02.504185 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:02.504185 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:02.505145 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:06:02.505145 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:06:02.505145 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:06:02.505145 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:02.513089 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 365/747] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:06:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:02.518674 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab679511-8aef-47f3-98a2-e112524ed510 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:02.589037 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:02.634631 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792ffd4-f7a6-43a4-aa7e-f3fa4bb913b1 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:02.675127 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bf14e2-b388-4904-8d37-fa01b2916970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:02.676032 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf14e2-b388-4904-8d37-fa01b2916970 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:02.676437 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf14e2-b388-4904-8d37-fa01b2916970 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:02.676856 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf14e2-b388-4904-8d37-fa01b2916970 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:02.677792 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bf14e2-b388-4904-8d37-fa01b2916970 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:02.678274 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bf14e2-b388-4904-8d37-fa01b2916970 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:02.679870 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bf14e2-b388-4904-8d37-fa01b2916970 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:02.697728 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 383/748] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Jun 18 04:06:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:02.703713 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bf14e2-b388-4904-8d37-fa01b2916970 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:02.779424 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab679511-8aef-47f3-98a2-e112524ed510 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:02.817184 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:02.826872 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a0bbff-c2bd-4a70-a9b4-06bc5aa96e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:02.827607 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0bbff-c2bd-4a70-a9b4-06bc5aa96e05 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:02.827882 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0bbff-c2bd-4a70-a9b4-06bc5aa96e05 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:02.828149 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0bbff-c2bd-4a70-a9b4-06bc5aa96e05 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:02.828905 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a0bbff-c2bd-4a70-a9b4-06bc5aa96e05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:02.829206 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a0bbff-c2bd-4a70-a9b4-06bc5aa96e05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:02.830814 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a0bbff-c2bd-4a70-a9b4-06bc5aa96e05 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:02.833343 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bf14e2-b388-4904-8d37-fa01b2916970 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:02.843242 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 366/749] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:06:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:06:02.844564 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6f42d-552e-446e-87e5-1cbbfbd97593 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:02.844867 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6f42d-552e-446e-87e5-1cbbfbd97593 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:02.845137 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6f42d-552e-446e-87e5-1cbbfbd97593 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:02.846585 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 367/750] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:06:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:06:02.848043 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d6f42d-552e-446e-87e5-1cbbfbd97593 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:02.867830 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:02.877972 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860edcc8-4165-4491-87d8-96ad059464fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:02.878724 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860edcc8-4165-4491-87d8-96ad059464fb None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:02.879071 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860edcc8-4165-4491-87d8-96ad059464fb None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:02.879416 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860edcc8-4165-4491-87d8-96ad059464fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:02.880515 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860edcc8-4165-4491-87d8-96ad059464fb None admin] RBAC: Adding query filter params (role.id=f055a7ed241c4492a4f92494099bab54, scope.project.id=9649aee8c5554102bc4193003300a3ad, user.id=310a7b366bee40f38960d76e56b52986) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:02.880920 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860edcc8-4165-4491-87d8-96ad059464fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:02.882431 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860edcc8-4165-4491-87d8-96ad059464fb None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:02.890439 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 384/751] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Jun 18 04:06:02 2022] GET /identity/v3/role_assignments?user.id=310a7b366bee40f38960d76e56b52986&scope.project.id=9649aee8c5554102bc4193003300a3ad&role.id=f055a7ed241c4492a4f92494099bab54 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:02.891743 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462113d-c404-46eb-a7d0-d17c0765007b None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:02.896843 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462113d-c404-46eb-a7d0-d17c0765007b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:02.897420 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462113d-c404-46eb-a7d0-d17c0765007b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:02.935437 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-a462113d-c404-46eb-a7d0-d17c0765007b None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:06:02.936711 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a462113d-c404-46eb-a7d0-d17c0765007b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:06:03.046535 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 385/752] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:06:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 04:06:03.065058 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d6f42d-552e-446e-87e5-1cbbfbd97593 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:03.086232 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a462113d-c404-46eb-a7d0-d17c0765007b None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:03.122691 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4c33d-d8c8-4be6-b42b-40ffe939f200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:03.123507 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4c33d-d8c8-4be6-b42b-40ffe939f200 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:03.123785 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4c33d-d8c8-4be6-b42b-40ffe939f200 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:03.124054 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4c33d-d8c8-4be6-b42b-40ffe939f200 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:03.135572 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f4c33d-d8c8-4be6-b42b-40ffe939f200 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:03.137081 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f4c33d-d8c8-4be6-b42b-40ffe939f200 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:03.173086 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-90f4c33d-d8c8-4be6-b42b-40ffe939f200 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 04:06:03.173086 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:03.173086 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:03.173086 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:03.173086 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:03.173086 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:03.173086 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:03.173086 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:03.173086 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:03.173086 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:03.173086 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:03.173086 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:03.173086 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 04:06:03.173086 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 04:06:03.173086 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 04:06:03.174050 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 04:06:03.174050 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:03.174050 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:03.174050 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:03.174050 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:03.174050 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:03.174050 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:03.174050 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:03.174050 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:03.174050 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:03.174050 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:03.174050 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:03.174050 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:03.174050 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:03.174050 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:03.174050 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:03.174050 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:03.174927 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 04:06:03.174927 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 04:06:03.174927 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 04:06:03.174927 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 04:06:03.174927 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 04:06:03.174927 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 04:06:03.174927 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 04:06:03.174927 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:03.177483 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 368/753] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Jun 18 04:06:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 04:06:03.185857 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4c33d-d8c8-4be6-b42b-40ffe939f200 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:03.209738 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a462113d-c404-46eb-a7d0-d17c0765007b None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:03.234394 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:03.247071 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b2530-ad12-49e3-bd8e-64b58b3b7b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:03.247855 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b2530-ad12-49e3-bd8e-64b58b3b7b1c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:03.248134 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b2530-ad12-49e3-bd8e-64b58b3b7b1c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:03.252600 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b2530-ad12-49e3-bd8e-64b58b3b7b1c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:03.271537 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b2530-ad12-49e3-bd8e-64b58b3b7b1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:06:03.286025 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-007b2530-ad12-49e3-bd8e-64b58b3b7b1c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 04:06:03.286025 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:03.286025 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:03.286025 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:03.286025 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:03.286025 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:03.286025 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:03.286025 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:03.286025 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:03.286025 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:03.286025 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:03.286025 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:03.286025 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:06:03.286025 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:06:03.286025 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:06:03.286025 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:06:03.286943 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:06:03.286943 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:06:03.286943 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:06:03.286943 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:06:03.286943 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:03.286943 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:03.286943 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:03.286943 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:03.286943 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:03.286943 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:03.286943 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:03.286943 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:03.286943 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:03.286943 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:03.286943 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:03.286943 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:03.287771 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:03.287771 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:03.287771 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:03.287771 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:03.287771 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:06:03.287771 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:06:03.287771 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:06:03.287771 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:06:03.287771 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:06:03.287771 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:06:03.287771 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 04:06:03.287771 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:03.288905 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 386/754] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Jun 18 04:06:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:03.293680 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b2530-ad12-49e3-bd8e-64b58b3b7b1c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:03.309006 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:03.387263 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4c33d-d8c8-4be6-b42b-40ffe939f200 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:03.430705 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1015764-dba5-41a5-ac40-07aa5f97e22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:03.431423 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1015764-dba5-41a5-ac40-07aa5f97e22a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:03.431702 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1015764-dba5-41a5-ac40-07aa5f97e22a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:03.431974 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1015764-dba5-41a5-ac40-07aa5f97e22a None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:03.432798 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1015764-dba5-41a5-ac40-07aa5f97e22a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:03.433106 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1015764-dba5-41a5-ac40-07aa5f97e22a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:03.434555 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1015764-dba5-41a5-ac40-07aa5f97e22a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:03.460609 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 369/755] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Jun 18 04:06:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:03.467751 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1015764-dba5-41a5-ac40-07aa5f97e22a None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:03.473286 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b2530-ad12-49e3-bd8e-64b58b3b7b1c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:03.542717 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e333818-f507-4afc-971a-ae0a599389ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:03.543394 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e333818-f507-4afc-971a-ae0a599389ab None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:03.543677 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e333818-f507-4afc-971a-ae0a599389ab None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:03.543949 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e333818-f507-4afc-971a-ae0a599389ab None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:03.544728 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e333818-f507-4afc-971a-ae0a599389ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:03.545044 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e333818-f507-4afc-971a-ae0a599389ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:03.547835 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e333818-f507-4afc-971a-ae0a599389ab None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:03.564787 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 387/756] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Jun 18 04:06:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:03.570531 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e333818-f507-4afc-971a-ae0a599389ab None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:03.651785 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:03.663356 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1015764-dba5-41a5-ac40-07aa5f97e22a None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:03.682242 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:03.738496 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d81c91-31e1-4ecc-9f6b-0405633b90a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:03.739157 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d81c91-31e1-4ecc-9f6b-0405633b90a4 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:03.739443 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d81c91-31e1-4ecc-9f6b-0405633b90a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:03.739707 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d81c91-31e1-4ecc-9f6b-0405633b90a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:03.740541 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d81c91-31e1-4ecc-9f6b-0405633b90a4 None admin] RBAC: Adding query filter params (role.id=d783a633c75847d48ef7ef5b169b0313, scope.project.id=9649aee8c5554102bc4193003300a3ad, user.id=fbfd82b05777466b97d46d376d4e11eb) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:03.740874 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d81c91-31e1-4ecc-9f6b-0405633b90a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:03.742321 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d81c91-31e1-4ecc-9f6b-0405633b90a4 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:03.751729 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e333818-f507-4afc-971a-ae0a599389ab None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:03.757860 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 370/757] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Jun 18 04:06:03 2022] GET /identity/v3/role_assignments?user.id=fbfd82b05777466b97d46d376d4e11eb&scope.project.id=9649aee8c5554102bc4193003300a3ad&role.id=d783a633c75847d48ef7ef5b169b0313 => generated 259 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:06:03.800296 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6209dfb7-5a3e-4188-8f16-8e5980618f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:03.801189 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6209dfb7-5a3e-4188-8f16-8e5980618f50 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:03.801462 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6209dfb7-5a3e-4188-8f16-8e5980618f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:03.801739 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6209dfb7-5a3e-4188-8f16-8e5980618f50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:03.815168 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6209dfb7-5a3e-4188-8f16-8e5980618f50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:03.816598 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6209dfb7-5a3e-4188-8f16-8e5980618f50 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:03.836763 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-6209dfb7-5a3e-4188-8f16-8e5980618f50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:06:03.836763 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:03.836763 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:03.836763 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:03.836763 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:03.836763 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:03.836763 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:03.836763 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:03.836763 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:03.836763 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:03.836763 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:03.836763 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:03.836763 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:06:03.836763 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:06:03.836763 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:06:03.837810 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:06:03.837810 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:03.837810 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:03.837810 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:03.837810 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:03.837810 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:03.837810 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:03.837810 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:03.837810 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:03.837810 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:03.837810 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:03.837810 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:03.837810 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:03.837810 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:03.837810 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:03.837810 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:03.837810 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:03.838678 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:06:03.838678 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:06:03.838678 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:06:03.838678 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:03.843062 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 388/758] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:06:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:03.844638 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d81c91-31e1-4ecc-9f6b-0405633b90a4 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:03.962276 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d81c91-31e1-4ecc-9f6b-0405633b90a4 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:03.998445 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5da99-752c-45cc-86d9-050af9cd30c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:03.999113 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5da99-752c-45cc-86d9-050af9cd30c0 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:03.999394 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5da99-752c-45cc-86d9-050af9cd30c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:03.999662 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5da99-752c-45cc-86d9-050af9cd30c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:04.000390 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e5da99-752c-45cc-86d9-050af9cd30c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:04.000726 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e5da99-752c-45cc-86d9-050af9cd30c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:04.002107 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e5da99-752c-45cc-86d9-050af9cd30c0 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:04.019166 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 371/759] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:06:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:04.020472 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6209dfb7-5a3e-4188-8f16-8e5980618f50 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:04.120069 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:04.127826 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6209dfb7-5a3e-4188-8f16-8e5980618f50 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:04.163703 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804fbd16-4e33-4736-b93c-d588634a315b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:04.164537 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804fbd16-4e33-4736-b93c-d588634a315b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:04.164852 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804fbd16-4e33-4736-b93c-d588634a315b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:04.165198 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804fbd16-4e33-4736-b93c-d588634a315b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:04.174132 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804fbd16-4e33-4736-b93c-d588634a315b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:04.175601 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804fbd16-4e33-4736-b93c-d588634a315b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:04.190461 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-804fbd16-4e33-4736-b93c-d588634a315b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 18 04:06:04.190461 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:04.190461 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:04.190461 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:04.190461 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:04.190461 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:04.190461 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:04.190461 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:04.190461 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:04.190461 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:04.190461 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:04.190461 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:04.190461 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 04:06:04.190461 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 04:06:04.190461 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 04:06:04.190461 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 04:06:04.191390 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:04.191390 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:04.191390 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 04:06:04.191390 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 04:06:04.191390 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 04:06:04.191390 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 04:06:04.191390 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:04.191390 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:04.191390 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:04.191390 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:04.191390 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:04.191390 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:04.191390 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:04.191390 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:04.191390 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:04.191390 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:04.191390 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:04.191390 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:04.192311 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:04.192311 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:04.192311 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 04:06:04.192311 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 04:06:04.192311 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 04:06:04.192311 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 04:06:04.192311 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 04:06:04.192311 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 04:06:04.192311 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 18 04:06:04.192311 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:04.196449 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 389/760] 10.222.0.20 () {56 vars in 1093 bytes} [Sat Jun 18 04:06:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:04.197867 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5da99-752c-45cc-86d9-050af9cd30c0 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:04.214851 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761e280-6685-4322-906d-5cf858dba29b None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:04.215175 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761e280-6685-4322-906d-5cf858dba29b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:04.215408 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761e280-6685-4322-906d-5cf858dba29b None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:04.217427 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 390/761] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:06:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:06:04.225929 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8fde56-8242-4c66-92b9-8303dd2ef8d2 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:04.226642 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8fde56-8242-4c66-92b9-8303dd2ef8d2 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:04.228483 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8fde56-8242-4c66-92b9-8303dd2ef8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:04.260192 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-4a8fde56-8242-4c66-92b9-8303dd2ef8d2 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:06:04.261920 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:04.263394 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-4a8fde56-8242-4c66-92b9-8303dd2ef8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:06:04.365858 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5da99-752c-45cc-86d9-050af9cd30c0 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:04.388970 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 391/762] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:06:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 04:06:04.426935 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8fde56-8242-4c66-92b9-8303dd2ef8d2 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:04.428127 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f35330-eca6-4860-ab34-a25f7a59769d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:04.428845 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f35330-eca6-4860-ab34-a25f7a59769d None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:04.429126 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f35330-eca6-4860-ab34-a25f7a59769d None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:04.429400 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f35330-eca6-4860-ab34-a25f7a59769d None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:04.430251 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f35330-eca6-4860-ab34-a25f7a59769d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:04.430656 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f35330-eca6-4860-ab34-a25f7a59769d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:04.432695 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f35330-eca6-4860-ab34-a25f7a59769d None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:04.464930 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 372/763] 10.222.0.20 () {56 vars in 1133 bytes} [Sat Jun 18 04:06:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:04.469672 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f35330-eca6-4860-ab34-a25f7a59769d None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:04.523509 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:04.540622 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8fde56-8242-4c66-92b9-8303dd2ef8d2 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:04.576721 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9201c8d4-2734-4c39-9f4d-e688083b3857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:04.578051 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9201c8d4-2734-4c39-9f4d-e688083b3857 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:04.578591 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9201c8d4-2734-4c39-9f4d-e688083b3857 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:04.579133 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9201c8d4-2734-4c39-9f4d-e688083b3857 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:04.579994 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9201c8d4-2734-4c39-9f4d-e688083b3857 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:04.581608 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9201c8d4-2734-4c39-9f4d-e688083b3857 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:04.594705 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-9201c8d4-2734-4c39-9f4d-e688083b3857 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 18 04:06:04.594705 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:04.594705 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 18 04:06:04.594705 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 18 04:06:04.594705 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 18 04:06:04.594705 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 18 04:06:04.594705 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 18 04:06:04.594705 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 04:06:04.594705 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 18 04:06:04.594705 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:04.594705 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 04:06:04.594705 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:04.594705 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:04.594705 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:04.594705 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:04.594705 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:04.595653 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:04.595653 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:04.595653 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:04.595653 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:04.595653 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:04.595653 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:04.595653 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:04.595653 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 18 04:06:04.595653 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 18 04:06:04.595653 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 18 04:06:04.595653 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 18 04:06:04.595653 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:04.595653 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:04.595653 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:04.595653 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:04.595653 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:04.596467 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:04.596467 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:04.596467 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:04.596467 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:04.596467 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:04.596467 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:04.596467 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:04.596467 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:04.596467 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:04.596467 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:04.596467 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:04.596467 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 18 04:06:04.596467 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 04:06:04.596467 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 18 04:06:04.596467 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:04.599455 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 392/764] 10.222.0.20 () {56 vars in 1129 bytes} [Sat Jun 18 04:06:04 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 04:06:04.605517 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9201c8d4-2734-4c39-9f4d-e688083b3857 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:04.706122 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:04.711250 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9201c8d4-2734-4c39-9f4d-e688083b3857 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:04.729724 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f35330-eca6-4860-ab34-a25f7a59769d None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:04.748963 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca16afed-da50-44e5-9edb-513993eb0c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:04.749987 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16afed-da50-44e5-9edb-513993eb0c74 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:04.750555 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16afed-da50-44e5-9edb-513993eb0c74 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:04.751045 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16afed-da50-44e5-9edb-513993eb0c74 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:04.751960 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca16afed-da50-44e5-9edb-513993eb0c74 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:04.752457 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca16afed-da50-44e5-9edb-513993eb0c74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:04.754270 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca16afed-da50-44e5-9edb-513993eb0c74 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:04.760392 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 393/765] 10.222.0.20 () {56 vars in 1124 bytes} [Sat Jun 18 04:06:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:06:04.766543 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca16afed-da50-44e5-9edb-513993eb0c74 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:04.769144 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e548a3-d32f-480a-a56e-6201996bcf36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:04.769952 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e548a3-d32f-480a-a56e-6201996bcf36 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:04.770363 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e548a3-d32f-480a-a56e-6201996bcf36 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:04.770486 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e548a3-d32f-480a-a56e-6201996bcf36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:04.787120 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e548a3-d32f-480a-a56e-6201996bcf36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:04.787120 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e548a3-d32f-480a-a56e-6201996bcf36 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:04.800936 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:04.820942 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-08e548a3-d32f-480a-a56e-6201996bcf36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:06:04.820942 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:04.820942 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:04.820942 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:04.820942 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:04.820942 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:04.820942 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:04.820942 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:04.820942 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:04.820942 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:04.820942 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:04.820942 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:04.820942 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:06:04.820942 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:06:04.820942 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:06:04.822155 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:06:04.822155 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:04.822155 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:04.822155 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:04.822155 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:04.822155 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:04.822155 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:04.822155 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:04.822155 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:04.822155 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:04.822155 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:04.822155 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:04.822155 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:04.822155 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:04.822155 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:04.822155 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:04.822155 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:04.823035 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:06:04.823035 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:06:04.823035 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:06:04.823035 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:04.824449 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 373/766] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:06:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 04:06:04.829345 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e548a3-d32f-480a-a56e-6201996bcf36 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:04.970437 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca16afed-da50-44e5-9edb-513993eb0c74 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:05.006375 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e548a3-d32f-480a-a56e-6201996bcf36 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:05.032002 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d120dbc8-c012-4115-a6b5-6918b0fca547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:05.033046 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120dbc8-c012-4115-a6b5-6918b0fca547 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:05.033396 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120dbc8-c012-4115-a6b5-6918b0fca547 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:05.033761 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120dbc8-c012-4115-a6b5-6918b0fca547 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:05.034553 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d120dbc8-c012-4115-a6b5-6918b0fca547 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:05.034935 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d120dbc8-c012-4115-a6b5-6918b0fca547 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:05.036511 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d120dbc8-c012-4115-a6b5-6918b0fca547 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:05.042227 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 394/767] 10.222.0.20 () {56 vars in 1124 bytes} [Sat Jun 18 04:06:04 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:05.043630 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85d23b-8774-4c6a-a87f-5a6e4d344b85 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:05.043988 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85d23b-8774-4c6a-a87f-5a6e4d344b85 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:05.044334 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85d23b-8774-4c6a-a87f-5a6e4d344b85 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:05.045951 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 395/768] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:06:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:06:05.047433 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85d23b-8774-4c6a-a87f-5a6e4d344b85 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:05.051935 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cdc770-768a-4f16-bfd6-4a82267b5c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:05.052844 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cdc770-768a-4f16-bfd6-4a82267b5c75 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:05.053309 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cdc770-768a-4f16-bfd6-4a82267b5c75 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:05.053745 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cdc770-768a-4f16-bfd6-4a82267b5c75 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:05.054638 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cdc770-768a-4f16-bfd6-4a82267b5c75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:05.055106 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cdc770-768a-4f16-bfd6-4a82267b5c75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:05.056759 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cdc770-768a-4f16-bfd6-4a82267b5c75 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:05.069807 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 374/769] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:06:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:05.071440 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a35b25-9a23-4c0b-9ef8-c603fc186ad9 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:05.071884 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a35b25-9a23-4c0b-9ef8-c603fc186ad9 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:05.072310 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a35b25-9a23-4c0b-9ef8-c603fc186ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:05.093780 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-99a35b25-9a23-4c0b-9ef8-c603fc186ad9 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:06:05.095244 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-99a35b25-9a23-4c0b-9ef8-c603fc186ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:06:05.101009 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:05.138221 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:05.162727 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85d23b-8774-4c6a-a87f-5a6e4d344b85 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:05.182881 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 375/770] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:06:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 04:06:05.182881 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a35b25-9a23-4c0b-9ef8-c603fc186ad9 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:05.210650 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a106e-0085-49a3-b9f2-5aec9a6cd8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:05.211759 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a106e-0085-49a3-b9f2-5aec9a6cd8de None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:05.212403 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a106e-0085-49a3-b9f2-5aec9a6cd8de None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:05.212889 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a106e-0085-49a3-b9f2-5aec9a6cd8de None admin] PATH_INFO: `/v3/endpoints` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:05.213888 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1a106e-0085-49a3-b9f2-5aec9a6cd8de None admin] RBAC: Adding query filter params (interface=public, service_id=f75f5de581c44809b20b30b5ffdffdfb, region_id=RegionOne) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:05.214396 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1a106e-0085-49a3-b9f2-5aec9a6cd8de None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:05.216269 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1a106e-0085-49a3-b9f2-5aec9a6cd8de None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:05.225455 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 396/771] 10.222.0.20 () {56 vars in 1251 bytes} [Sat Jun 18 04:06:05 2022] GET /identity/v3/endpoints?service_id=f75f5de581c44809b20b30b5ffdffdfb&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:05.226576 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a106e-0085-49a3-b9f2-5aec9a6cd8de None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:05.306721 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a35b25-9a23-4c0b-9ef8-c603fc186ad9 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:05.335932 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a106e-0085-49a3-b9f2-5aec9a6cd8de None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:05.337844 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:05.344121 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33feb81-c406-4b81-b81e-24071da2ae6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:05.344944 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33feb81-c406-4b81-b81e-24071da2ae6e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:05.345214 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33feb81-c406-4b81-b81e-24071da2ae6e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:05.345479 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33feb81-c406-4b81-b81e-24071da2ae6e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:05.352264 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33feb81-c406-4b81-b81e-24071da2ae6e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:05.353776 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33feb81-c406-4b81-b81e-24071da2ae6e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:05.368479 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-d33feb81-c406-4b81-b81e-24071da2ae6e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 04:06:05.368479 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:05.368479 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:05.368479 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:05.368479 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:05.368479 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:05.368479 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:05.368479 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:05.368479 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:05.368479 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:05.368479 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:05.368479 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:05.368479 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 04:06:05.368479 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 04:06:05.368479 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 04:06:05.369572 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 04:06:05.369572 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:05.369572 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:05.369572 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:05.369572 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:05.369572 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:05.369572 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:05.369572 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:05.369572 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:05.369572 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:05.369572 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:05.369572 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:05.369572 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:05.369572 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:05.369572 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:05.369572 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:05.369572 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:05.371071 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 04:06:05.371071 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 04:06:05.371071 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 04:06:05.371071 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 04:06:05.371071 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 04:06:05.371071 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 04:06:05.371071 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 04:06:05.371071 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:05.371071 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 376/772] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Jun 18 04:06:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:05.371071 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33feb81-c406-4b81-b81e-24071da2ae6e None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:05.376739 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf2cb87-6698-4d1d-ba60-4c4d12745358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:05.377542 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2cb87-6698-4d1d-ba60-4c4d12745358 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:05.377815 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2cb87-6698-4d1d-ba60-4c4d12745358 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:05.378105 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2cb87-6698-4d1d-ba60-4c4d12745358 None admin] PATH_INFO: `/v3/services/network` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:05.378751 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf2cb87-6698-4d1d-ba60-4c4d12745358 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:05.380095 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf2cb87-6698-4d1d-ba60-4c4d12745358 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:05.392042 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-8cf2cb87-6698-4d1d-ba60-4c4d12745358 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 18 04:06:05.392042 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:05.392042 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 18 04:06:05.392042 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 18 04:06:05.392042 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 18 04:06:05.392042 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 18 04:06:05.392042 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 18 04:06:05.392042 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 04:06:05.392042 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 18 04:06:05.392042 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:05.392042 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 04:06:05.392042 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:05.392042 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:05.392042 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:05.392042 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:05.392042 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:05.392042 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:05.393099 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:05.393099 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:05.393099 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:05.393099 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:05.393099 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:05.393099 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:05.393099 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 18 04:06:05.393099 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 18 04:06:05.393099 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 18 04:06:05.393099 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 18 04:06:05.393099 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:05.393099 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:05.393099 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:05.393099 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:05.393099 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:05.393099 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:05.394525 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:05.394525 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:05.394525 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:05.394525 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:05.394525 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:05.394525 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:05.394525 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:05.394525 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:05.394525 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:05.394525 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:05.394525 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 18 04:06:05.394525 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 04:06:05.394525 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 18 04:06:05.394525 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:05.394525 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 397/773] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Jun 18 04:06:05 2022] GET /identity/v3/services/network => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:05.395336 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960a818-2fa9-41c0-9737-dc641299e722 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:05.395336 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960a818-2fa9-41c0-9737-dc641299e722 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:05.395336 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960a818-2fa9-41c0-9737-dc641299e722 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:05.401227 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 398/774] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:06:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:06:05.401227 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4960a818-2fa9-41c0-9737-dc641299e722 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:05.407501 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:05.481794 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33feb81-c406-4b81-b81e-24071da2ae6e None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:05.506782 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4960a818-2fa9-41c0-9737-dc641299e722 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:05.518537 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa0078-de30-4ecd-b3e3-20b5dcdcf5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:05.519365 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa0078-de30-4ecd-b3e3-20b5dcdcf5bc None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:05.519704 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa0078-de30-4ecd-b3e3-20b5dcdcf5bc None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:05.520146 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa0078-de30-4ecd-b3e3-20b5dcdcf5bc None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:05.520923 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aa0078-de30-4ecd-b3e3-20b5dcdcf5bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:05.522345 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aa0078-de30-4ecd-b3e3-20b5dcdcf5bc None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:05.528263 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 377/775] 10.222.0.20 () {56 vars in 1087 bytes} [Sat Jun 18 04:06:05 2022] GET /identity/v3/services => generated 772 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:05.529153 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa0078-de30-4ecd-b3e3-20b5dcdcf5bc None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:05.546137 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c23a08-2e09-4198-9502-89ef4a8e0f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:05.547747 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c23a08-2e09-4198-9502-89ef4a8e0f7c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:05.548815 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c23a08-2e09-4198-9502-89ef4a8e0f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:05.549247 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c23a08-2e09-4198-9502-89ef4a8e0f7c None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:05.550526 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c23a08-2e09-4198-9502-89ef4a8e0f7c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:05.551026 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c23a08-2e09-4198-9502-89ef4a8e0f7c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:05.553544 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c23a08-2e09-4198-9502-89ef4a8e0f7c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:05.579274 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 399/776] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Jun 18 04:06:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:05.579274 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141102a-ecd2-4e32-8011-9b52a29fa682 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:05.579274 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141102a-ecd2-4e32-8011-9b52a29fa682 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:05.579274 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141102a-ecd2-4e32-8011-9b52a29fa682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:05.605278 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-5141102a-ecd2-4e32-8011-9b52a29fa682 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:06:05.606587 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:05.608976 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-5141102a-ecd2-4e32-8011-9b52a29fa682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:06:05.660264 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa0078-de30-4ecd-b3e3-20b5dcdcf5bc None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:05.689517 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:05.699864 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 400/777] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:06:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 04:06:05.700714 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5141102a-ecd2-4e32-8011-9b52a29fa682 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:05.720923 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ef256-6ca7-4d9b-867e-72c0161780ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:05.721594 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ef256-6ca7-4d9b-867e-72c0161780ba None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:05.721867 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ef256-6ca7-4d9b-867e-72c0161780ba None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:05.722130 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ef256-6ca7-4d9b-867e-72c0161780ba None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:05.722841 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ef256-6ca7-4d9b-867e-72c0161780ba None admin] RBAC: Adding query filter params (name=network) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:05.723138 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ef256-6ca7-4d9b-867e-72c0161780ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:05.724534 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ef256-6ca7-4d9b-867e-72c0161780ba None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:05.736113 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 378/778] 10.222.0.20 () {56 vars in 1112 bytes} [Sat Jun 18 04:06:05 2022] GET /identity/v3/services?name=network => generated 124 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:05.736765 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ef256-6ca7-4d9b-867e-72c0161780ba None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:05.845778 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ef256-6ca7-4d9b-867e-72c0161780ba None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:05.846169 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5141102a-ecd2-4e32-8011-9b52a29fa682 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:05.867998 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:05.887784 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c625a-00c7-4fa4-bc75-6abc8ae26b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:05.888598 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c625a-00c7-4fa4-bc75-6abc8ae26b5b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:05.888908 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c625a-00c7-4fa4-bc75-6abc8ae26b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:05.889272 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c625a-00c7-4fa4-bc75-6abc8ae26b5b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:05.893335 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc245b1-79b7-45bc-b848-ab4924394ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:05.894701 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc245b1-79b7-45bc-b848-ab4924394ec8 None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:05.895146 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc245b1-79b7-45bc-b848-ab4924394ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:05.895572 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc245b1-79b7-45bc-b848-ab4924394ec8 None admin] PATH_INFO: `/v3/projects/9649aee8c5554102bc4193003300a3ad/users/c129f3de2bb2431593fac649fd4975b3/roles/d783a633c75847d48ef7ef5b169b0313` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:05.898366 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc245b1-79b7-45bc-b848-ab4924394ec8 None admin] RBAC: Authorizing `identity:create_grant(project_id=9649aee8c5554102bc4193003300a3ad, user_id=c129f3de2bb2431593fac649fd4975b3, role_id=d783a633c75847d48ef7ef5b169b0313)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:05.900379 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c625a-00c7-4fa4-bc75-6abc8ae26b5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:06:05.900508 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc245b1-79b7-45bc-b848-ab4924394ec8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:05.908892 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-2c2c625a-00c7-4fa4-bc75-6abc8ae26b5b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 18 04:06:05.908892 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:05.908892 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:05.908892 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:05.908892 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:05.908892 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:05.908892 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:05.908892 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:05.908892 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:05.908892 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:05.908892 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:05.908892 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:05.908892 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:06:05.908892 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:06:05.908892 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:06:05.908892 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:06:05.910176 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:06:05.910176 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:06:05.910176 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:06:05.910176 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:06:05.910176 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:05.910176 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:05.910176 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:05.910176 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:05.910176 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:05.910176 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:05.910176 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:05.910176 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:05.910176 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:05.910176 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:05.910176 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:05.910176 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:05.911488 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:05.911488 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:05.911488 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:05.911488 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:05.911488 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:06:05.911488 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:06:05.911488 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:06:05.911488 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:06:05.911488 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:06:05.911488 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:06:05.911488 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 18 04:06:05.911488 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:05.915271 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 379/779] 10.222.0.20 () {56 vars in 1102 bytes} [Sat Jun 18 04:06:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:05.916146 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c625a-00c7-4fa4-bc75-6abc8ae26b5b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:05.927869 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 401/780] 10.222.0.20 () {58 vars in 1439 bytes} [Sat Jun 18 04:06:05 2022] PUT /identity/v3/projects/9649aee8c5554102bc4193003300a3ad/users/c129f3de2bb2431593fac649fd4975b3/roles/d783a633c75847d48ef7ef5b169b0313 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 04:06:05.929231 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc245b1-79b7-45bc-b848-ab4924394ec8 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:06.058012 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:06.126040 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc245b1-79b7-45bc-b848-ab4924394ec8 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:06.126249 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c625a-00c7-4fa4-bc75-6abc8ae26b5b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:06.176567 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a93ee-a2bc-45ef-824a-1c60d45df0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:06.177461 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a93ee-a2bc-45ef-824a-1c60d45df0c3 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:06.177571 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a93ee-a2bc-45ef-824a-1c60d45df0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:06.178230 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a93ee-a2bc-45ef-824a-1c60d45df0c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:06.178334 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f58ad6-724b-4212-906e-0bdc8210d6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:06.178528 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a93ee-a2bc-45ef-824a-1c60d45df0c3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:06.178625 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f58ad6-724b-4212-906e-0bdc8210d6d8 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:06.178790 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f58ad6-724b-4212-906e-0bdc8210d6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:06.178881 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a93ee-a2bc-45ef-824a-1c60d45df0c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:06.179785 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f58ad6-724b-4212-906e-0bdc8210d6d8 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:06.179785 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f58ad6-724b-4212-906e-0bdc8210d6d8 None admin] RBAC: Adding query filter params (type=network) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:06.180047 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f58ad6-724b-4212-906e-0bdc8210d6d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:06.181044 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a93ee-a2bc-45ef-824a-1c60d45df0c3 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:06.181477 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f58ad6-724b-4212-906e-0bdc8210d6d8 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:06.187014 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 380/781] 10.222.0.20 () {56 vars in 1112 bytes} [Sat Jun 18 04:06:05 2022] GET /identity/v3/services?type=network => generated 350 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:06.188493 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4771577-397f-4411-8522-8c35bac6e68f None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:06.188798 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4771577-397f-4411-8522-8c35bac6e68f None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:06.189069 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4771577-397f-4411-8522-8c35bac6e68f None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:06.189895 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 402/782] 10.222.0.20 () {56 vars in 1103 bytes} [Sat Jun 18 04:06:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:06.190501 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 381/783] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:06:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:06:06.193425 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a93ee-a2bc-45ef-824a-1c60d45df0c3 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:06.195102 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4771577-397f-4411-8522-8c35bac6e68f None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:06.243547 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:06.298547 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4771577-397f-4411-8522-8c35bac6e68f None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:06.321504 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a93ee-a2bc-45ef-824a-1c60d45df0c3 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:06.338806 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb6e0e4-73a3-40cf-aedb-c76721eb6016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:06.339743 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6e0e4-73a3-40cf-aedb-c76721eb6016 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:06.340049 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6e0e4-73a3-40cf-aedb-c76721eb6016 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:06.340326 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6e0e4-73a3-40cf-aedb-c76721eb6016 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:06.351901 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:06.353511 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb6e0e4-73a3-40cf-aedb-c76721eb6016 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:06.355691 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb6e0e4-73a3-40cf-aedb-c76721eb6016 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:06.369144 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53397ec4-054f-4027-a64f-068f9a4e3b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:06.370015 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53397ec4-054f-4027-a64f-068f9a4e3b0e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:06.370393 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53397ec4-054f-4027-a64f-068f9a4e3b0e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:06.370791 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53397ec4-054f-4027-a64f-068f9a4e3b0e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:06.371686 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53397ec4-054f-4027-a64f-068f9a4e3b0e None admin] RBAC: Adding query filter params (interface=public, service_id=1fd35bedc9fc4ce68754d7332801608b, region_id=RegionOne) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:06.372102 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53397ec4-054f-4027-a64f-068f9a4e3b0e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:06.373613 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53397ec4-054f-4027-a64f-068f9a4e3b0e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:06.375754 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-8cb6e0e4-73a3-40cf-aedb-c76721eb6016 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:06:06.375754 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:06.375754 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:06.375754 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:06.375754 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:06.375754 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:06.375754 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:06.375754 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:06.375754 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:06.375754 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:06.375754 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:06.375754 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:06.375754 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:06:06.375754 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:06:06.375754 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:06:06.376803 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:06:06.376803 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:06.376803 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:06.376803 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:06.376803 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:06.376803 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:06.376803 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:06.376803 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:06.376803 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:06.376803 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:06.376803 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:06.376803 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:06.376803 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:06.376803 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:06.376803 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:06.376803 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:06.376803 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:06.377847 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:06:06.377847 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:06:06.377847 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:06:06.377847 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:06.377847 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 382/784] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:06:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 04:06:06.378974 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e1385-4c59-4f35-a0ec-131655dfc629 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:06.379292 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e1385-4c59-4f35-a0ec-131655dfc629 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:06.379531 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e1385-4c59-4f35-a0ec-131655dfc629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:06.382394 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 403/785] 10.222.0.20 () {56 vars in 1251 bytes} [Sat Jun 18 04:06:06 2022] GET /identity/v3/endpoints?service_id=1fd35bedc9fc4ce68754d7332801608b&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:06.384838 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53397ec4-054f-4027-a64f-068f9a4e3b0e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:06.398406 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-1d7e1385-4c59-4f35-a0ec-131655dfc629 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:06:06.399972 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-1d7e1385-4c59-4f35-a0ec-131655dfc629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:06:06.482815 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 383/786] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:06:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 04:06:06.483985 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e1385-4c59-4f35-a0ec-131655dfc629 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:06.507221 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53397ec4-054f-4027-a64f-068f9a4e3b0e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:06.532523 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:06.554499 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5413a9f9-2492-4c0a-8209-9820150d388c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:06.555334 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413a9f9-2492-4c0a-8209-9820150d388c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:06.555776 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413a9f9-2492-4c0a-8209-9820150d388c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:06.556140 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413a9f9-2492-4c0a-8209-9820150d388c None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:06.557325 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5413a9f9-2492-4c0a-8209-9820150d388c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:06.557796 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5413a9f9-2492-4c0a-8209-9820150d388c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:06.559919 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5413a9f9-2492-4c0a-8209-9820150d388c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:06.579969 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 404/787] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:06.581181 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5413a9f9-2492-4c0a-8209-9820150d388c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:06.627052 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:06.628849 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e1385-4c59-4f35-a0ec-131655dfc629 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:06.673665 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c292662-c29a-4f95-be26-04e992dc0e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:06.674429 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c292662-c29a-4f95-be26-04e992dc0e29 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:06.674784 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c292662-c29a-4f95-be26-04e992dc0e29 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:06.675119 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c292662-c29a-4f95-be26-04e992dc0e29 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:06.676481 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c292662-c29a-4f95-be26-04e992dc0e29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:06.678212 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c292662-c29a-4f95-be26-04e992dc0e29 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:06.685790 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 384/788] 10.222.0.20 () {56 vars in 1087 bytes} [Sat Jun 18 04:06:06 2022] GET /identity/v3/services => generated 772 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:06.687265 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c292662-c29a-4f95-be26-04e992dc0e29 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:06.689034 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5413a9f9-2492-4c0a-8209-9820150d388c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:06.775452 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71252ce9-6117-43ee-91a2-df63faf11e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:06.777679 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71252ce9-6117-43ee-91a2-df63faf11e00 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:06.778323 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71252ce9-6117-43ee-91a2-df63faf11e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:06.782330 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71252ce9-6117-43ee-91a2-df63faf11e00 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:06.807517 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71252ce9-6117-43ee-91a2-df63faf11e00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:06:06.829854 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-71252ce9-6117-43ee-91a2-df63faf11e00 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 04:06:06.829854 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:06.829854 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:06.829854 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:06.829854 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:06.829854 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:06.829854 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:06.829854 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:06.829854 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:06.829854 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:06.829854 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:06.829854 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:06.829854 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:06:06.829854 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:06:06.829854 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:06:06.829854 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:06:06.830942 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:06:06.830942 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:06:06.830942 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:06:06.830942 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:06:06.830942 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:06.830942 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:06.830942 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:06.830942 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:06.830942 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:06.830942 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:06.830942 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:06.830942 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:06.830942 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:06.830942 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:06.830942 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:06.830942 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:06.833478 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:06.833478 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:06.833478 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:06.833478 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:06.833478 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:06:06.833478 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:06:06.833478 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:06:06.833478 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:06:06.833478 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:06:06.833478 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:06:06.833478 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 04:06:06.833478 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:06.842088 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 405/789] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Jun 18 04:06:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:06.846576 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71252ce9-6117-43ee-91a2-df63faf11e00 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:06.890667 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:06.906193 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c292662-c29a-4f95-be26-04e992dc0e29 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:06.947914 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a428866-7953-4400-8ada-763ea46cef3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:06.949245 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a428866-7953-4400-8ada-763ea46cef3f None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:06.949393 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a428866-7953-4400-8ada-763ea46cef3f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:06.949726 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a428866-7953-4400-8ada-763ea46cef3f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:06.958097 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a428866-7953-4400-8ada-763ea46cef3f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:06.963507 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a428866-7953-4400-8ada-763ea46cef3f None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:06.977813 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71252ce9-6117-43ee-91a2-df63faf11e00 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:06.979602 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:06.981737 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-9a428866-7953-4400-8ada-763ea46cef3f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 18 04:06:06.981737 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:06.981737 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:06.981737 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:06.981737 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:06.981737 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:06.981737 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:06.981737 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:06.981737 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:06.981737 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:06.981737 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:06.981737 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:06.981737 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 04:06:06.981737 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 04:06:06.981737 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 04:06:06.981737 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 04:06:06.982842 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:06.982842 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:06.982842 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 04:06:06.982842 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 04:06:06.982842 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 04:06:06.982842 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 04:06:06.982842 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:06.982842 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:06.982842 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:06.982842 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:06.982842 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:06.982842 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:06.982842 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:06.982842 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:06.982842 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:06.982842 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:06.982842 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:06.982842 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:06.984490 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:06.984490 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:06.984490 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 04:06:06.984490 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 04:06:06.984490 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 04:06:06.984490 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 04:06:06.984490 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 04:06:06.984490 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 04:06:06.984490 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 18 04:06:06.984490 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:06.987125 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 385/790] 10.222.0.20 () {56 vars in 1117 bytes} [Sat Jun 18 04:06:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:06.992970 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a428866-7953-4400-8ada-763ea46cef3f None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:07.019138 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c28408-d003-4e86-ac32-88a35a0f8fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:07.020097 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c28408-d003-4e86-ac32-88a35a0f8fe8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:07.020509 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c28408-d003-4e86-ac32-88a35a0f8fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:07.020979 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c28408-d003-4e86-ac32-88a35a0f8fe8 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:07.021889 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c28408-d003-4e86-ac32-88a35a0f8fe8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:07.022323 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c28408-d003-4e86-ac32-88a35a0f8fe8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:07.023898 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c28408-d003-4e86-ac32-88a35a0f8fe8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:07.033365 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 406/791] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Jun 18 04:06:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:07.038444 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c28408-d003-4e86-ac32-88a35a0f8fe8 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:07.161321 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c28408-d003-4e86-ac32-88a35a0f8fe8 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:07.178112 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a428866-7953-4400-8ada-763ea46cef3f None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:07.199954 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b4771-8618-4f53-8242-ca7fd5ba91f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:07.201107 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b4771-8618-4f53-8242-ca7fd5ba91f9 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:07.201871 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b4771-8618-4f53-8242-ca7fd5ba91f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:07.202599 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b4771-8618-4f53-8242-ca7fd5ba91f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:07.229492 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b4771-8618-4f53-8242-ca7fd5ba91f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:07.230965 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b4771-8618-4f53-8242-ca7fd5ba91f9 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:07.254321 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c96dd3-cfc5-4db0-80c8-00777a417087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:07.254993 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c96dd3-cfc5-4db0-80c8-00777a417087 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:07.255265 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c96dd3-cfc5-4db0-80c8-00777a417087 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:07.255532 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c96dd3-cfc5-4db0-80c8-00777a417087 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:07.256369 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c96dd3-cfc5-4db0-80c8-00777a417087 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:07.256695 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c96dd3-cfc5-4db0-80c8-00777a417087 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:07.258128 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c96dd3-cfc5-4db0-80c8-00777a417087 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:07.264092 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-9d0b4771-8618-4f53-8242-ca7fd5ba91f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:06:07.264092 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:07.264092 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:07.264092 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:07.264092 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:07.264092 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:07.264092 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:07.264092 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:07.264092 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:07.264092 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:07.264092 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:07.264092 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:07.264092 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:06:07.264092 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:06:07.264092 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:06:07.265023 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:06:07.265023 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:07.265023 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:07.265023 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:07.265023 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:07.265023 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:07.265023 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:07.265023 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:07.265023 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:07.265023 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:07.265023 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:07.265023 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:07.265023 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:07.265023 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:07.265023 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:07.265023 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:07.265023 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:07.265946 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:06:07.265946 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:06:07.265946 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:06:07.265946 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:07.265946 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 407/792] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:06:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:07.271453 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b4771-8618-4f53-8242-ca7fd5ba91f9 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:07.292983 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 386/793] 10.222.0.20 () {56 vars in 1149 bytes} [Sat Jun 18 04:06:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:07.302084 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c96dd3-cfc5-4db0-80c8-00777a417087 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:07.311020 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:07.321011 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:07.458203 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b4771-8618-4f53-8242-ca7fd5ba91f9 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:07.482187 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c96dd3-cfc5-4db0-80c8-00777a417087 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:07.519939 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e525bcb-4a30-42ae-b81e-b177959cf6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:07.520923 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e525bcb-4a30-42ae-b81e-b177959cf6ba None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:07.521201 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e525bcb-4a30-42ae-b81e-b177959cf6ba None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:07.521469 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e525bcb-4a30-42ae-b81e-b177959cf6ba None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:07.522195 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e525bcb-4a30-42ae-b81e-b177959cf6ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:07.522504 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e525bcb-4a30-42ae-b81e-b177959cf6ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:07.524123 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e525bcb-4a30-42ae-b81e-b177959cf6ba None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:07.544077 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 408/794] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:06:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:07.546001 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f023f83-aabb-464c-88b6-3bd01d10fc88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:07.546801 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f023f83-aabb-464c-88b6-3bd01d10fc88 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:07.547074 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f023f83-aabb-464c-88b6-3bd01d10fc88 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:07.547342 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f023f83-aabb-464c-88b6-3bd01d10fc88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:07.550169 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e525bcb-4a30-42ae-b81e-b177959cf6ba None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:07.559223 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f023f83-aabb-464c-88b6-3bd01d10fc88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:07.560702 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f023f83-aabb-464c-88b6-3bd01d10fc88 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:07.584616 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-4f023f83-aabb-464c-88b6-3bd01d10fc88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:06:07.584616 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:07.584616 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:07.584616 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:07.584616 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:07.584616 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:07.584616 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:07.584616 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:07.584616 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:07.584616 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:07.584616 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:07.584616 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:07.584616 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:06:07.584616 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:06:07.584616 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:06:07.585544 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:06:07.585544 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:07.585544 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:07.585544 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:07.585544 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:07.585544 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:07.585544 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:07.585544 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:07.585544 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:07.585544 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:07.585544 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:07.585544 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:07.585544 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:07.585544 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:07.585544 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:07.585544 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:07.585544 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:07.586451 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:06:07.586451 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:06:07.586451 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:06:07.586451 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:07.586451 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 387/795] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:06:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:07.587827 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f023f83-aabb-464c-88b6-3bd01d10fc88 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:07.678344 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:07.693171 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:07.710872 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e525bcb-4a30-42ae-b81e-b177959cf6ba None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:07.743191 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f023f83-aabb-464c-88b6-3bd01d10fc88 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:07.750392 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48561938-7104-4af5-9101-ad2274e6fb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:07.751488 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48561938-7104-4af5-9101-ad2274e6fb79 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:07.751998 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48561938-7104-4af5-9101-ad2274e6fb79 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:07.752470 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48561938-7104-4af5-9101-ad2274e6fb79 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:07.760946 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48561938-7104-4af5-9101-ad2274e6fb79 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:07.762780 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48561938-7104-4af5-9101-ad2274e6fb79 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:07.779403 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-48561938-7104-4af5-9101-ad2274e6fb79 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 18 04:06:07.779403 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:07.779403 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:07.779403 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:07.779403 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:07.779403 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:07.779403 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:07.779403 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:07.779403 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:07.779403 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:07.779403 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:07.779403 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:07.779403 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 04:06:07.779403 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 04:06:07.779403 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 04:06:07.779403 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 04:06:07.780415 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:07.780415 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:07.780415 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 04:06:07.780415 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 04:06:07.780415 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 04:06:07.780415 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 04:06:07.780415 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:07.780415 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:07.780415 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:07.780415 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:07.780415 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:07.780415 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:07.780415 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:07.780415 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:07.780415 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:07.780415 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:07.780415 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:07.780415 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:07.781437 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:07.781437 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:07.781437 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 04:06:07.781437 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 04:06:07.781437 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 04:06:07.781437 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 04:06:07.781437 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 04:06:07.781437 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 04:06:07.781437 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 18 04:06:07.781437 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:07.781995 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f8edc-85e0-4812-b8ef-d0bbf80c0716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:07.781995 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f8edc-85e0-4812-b8ef-d0bbf80c0716 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:07.781995 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f8edc-85e0-4812-b8ef-d0bbf80c0716 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:07.781995 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f8edc-85e0-4812-b8ef-d0bbf80c0716 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:07.782282 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f8edc-85e0-4812-b8ef-d0bbf80c0716 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:07.782282 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f8edc-85e0-4812-b8ef-d0bbf80c0716 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:07.783047 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f8edc-85e0-4812-b8ef-d0bbf80c0716 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:07.784782 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 409/796] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Jun 18 04:06:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:07.786281 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ebad1-079f-44f7-a377-7f0df4c11ab0 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:07.786794 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ebad1-079f-44f7-a377-7f0df4c11ab0 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:07.787264 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ebad1-079f-44f7-a377-7f0df4c11ab0 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:07.789022 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 410/797] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:06:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:06:07.790330 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ebad1-079f-44f7-a377-7f0df4c11ab0 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:07.795573 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 388/798] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:06:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:07.801185 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac815073-9ad1-47e0-a221-40d83c10856d None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:07.801467 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac815073-9ad1-47e0-a221-40d83c10856d None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:07.801740 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac815073-9ad1-47e0-a221-40d83c10856d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:07.818631 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-ac815073-9ad1-47e0-a221-40d83c10856d None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:06:07.819844 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ac815073-9ad1-47e0-a221-40d83c10856d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:06:07.898584 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 389/799] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:06:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 04:06:07.899538 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac815073-9ad1-47e0-a221-40d83c10856d None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:07.913425 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ebad1-079f-44f7-a377-7f0df4c11ab0 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:07.949665 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d1ba7-4b5d-47e5-88c0-7bf4fd32eec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:07.950721 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d1ba7-4b5d-47e5-88c0-7bf4fd32eec4 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:07.951227 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d1ba7-4b5d-47e5-88c0-7bf4fd32eec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:07.951704 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d1ba7-4b5d-47e5-88c0-7bf4fd32eec4 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:07.952796 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d1ba7-4b5d-47e5-88c0-7bf4fd32eec4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:07.953306 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d1ba7-4b5d-47e5-88c0-7bf4fd32eec4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:07.955418 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:07.958499 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d1ba7-4b5d-47e5-88c0-7bf4fd32eec4 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:07.966684 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:07.983663 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 411/800] 10.222.0.20 () {56 vars in 1135 bytes} [Sat Jun 18 04:06:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:07.984909 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d1ba7-4b5d-47e5-88c0-7bf4fd32eec4 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:08.016654 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac815073-9ad1-47e0-a221-40d83c10856d None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:08.052804 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c25d5-67bc-4db5-ab89-eb4125c81372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:08.054025 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c25d5-67bc-4db5-ab89-eb4125c81372 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:08.054477 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c25d5-67bc-4db5-ab89-eb4125c81372 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:08.054961 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c25d5-67bc-4db5-ab89-eb4125c81372 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:08.062431 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c25d5-67bc-4db5-ab89-eb4125c81372 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:08.064110 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c25d5-67bc-4db5-ab89-eb4125c81372 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:08.078786 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-d64c25d5-67bc-4db5-ab89-eb4125c81372 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 04:06:08.078786 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:08.078786 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:08.078786 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:08.078786 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:08.078786 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:08.078786 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:08.078786 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:08.078786 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:08.078786 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:08.078786 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:08.078786 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:08.078786 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 04:06:08.078786 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 04:06:08.078786 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 04:06:08.079674 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 04:06:08.079674 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:08.079674 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:08.079674 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:08.079674 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:08.079674 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:08.079674 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:08.079674 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:08.079674 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:08.079674 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:08.079674 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:08.079674 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:08.079674 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:08.079674 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:08.079674 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:08.079674 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:08.079674 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:08.080540 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 04:06:08.080540 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 04:06:08.080540 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 04:06:08.080540 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 04:06:08.080540 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 04:06:08.080540 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 04:06:08.080540 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 04:06:08.080540 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:08.082647 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 390/801] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Jun 18 04:06:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:08.088044 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c25d5-67bc-4db5-ab89-eb4125c81372 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:08.091748 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d1ba7-4b5d-47e5-88c0-7bf4fd32eec4 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:08.128290 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4663ec-dbf0-48e7-9bb3-fdcb7e501b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:08.129165 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4663ec-dbf0-48e7-9bb3-fdcb7e501b98 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:08.129440 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4663ec-dbf0-48e7-9bb3-fdcb7e501b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:08.129706 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4663ec-dbf0-48e7-9bb3-fdcb7e501b98 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:08.130368 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4663ec-dbf0-48e7-9bb3-fdcb7e501b98 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:08.131758 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4663ec-dbf0-48e7-9bb3-fdcb7e501b98 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:08.144494 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-2f4663ec-dbf0-48e7-9bb3-fdcb7e501b98 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 18 04:06:08.144494 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:08.144494 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 18 04:06:08.144494 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 18 04:06:08.144494 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 18 04:06:08.144494 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 18 04:06:08.144494 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 18 04:06:08.144494 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 04:06:08.144494 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 18 04:06:08.144494 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:08.144494 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 04:06:08.144494 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:08.144494 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:08.144494 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:08.144494 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:08.144494 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:08.154255 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:08.154255 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:08.154255 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:08.154255 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:08.154255 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:08.154255 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:08.154255 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:08.154255 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 18 04:06:08.154255 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 18 04:06:08.154255 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 18 04:06:08.154255 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 18 04:06:08.154255 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:08.154255 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:08.154255 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:08.154255 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:08.154255 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:08.159644 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:08.159644 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:08.159644 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:08.159644 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:08.159644 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:08.159644 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:08.159644 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:08.159644 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:08.159644 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:08.159644 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:08.159644 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:08.159644 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 18 04:06:08.159644 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 04:06:08.159644 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 18 04:06:08.159644 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:08.159644 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 412/802] 10.222.0.20 () {56 vars in 1129 bytes} [Sat Jun 18 04:06:07 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:08.161387 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4663ec-dbf0-48e7-9bb3-fdcb7e501b98 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:08.211687 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:08.229296 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c25d5-67bc-4db5-ab89-eb4125c81372 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:08.240421 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:08.256348 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4663ec-dbf0-48e7-9bb3-fdcb7e501b98 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:08.265400 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e5d87-9e13-4d1c-9603-e57f92ef33db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:08.266204 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e5d87-9e13-4d1c-9603-e57f92ef33db None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:08.266480 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e5d87-9e13-4d1c-9603-e57f92ef33db None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:08.266747 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e5d87-9e13-4d1c-9603-e57f92ef33db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:08.277912 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554e5d87-9e13-4d1c-9603-e57f92ef33db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:08.279366 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554e5d87-9e13-4d1c-9603-e57f92ef33db None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:08.293440 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f0f78-98c8-4203-9945-5c4219d53bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:08.294329 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f0f78-98c8-4203-9945-5c4219d53bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:08.294750 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f0f78-98c8-4203-9945-5c4219d53bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:08.295158 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f0f78-98c8-4203-9945-5c4219d53bc7 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:08.296085 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f0f78-98c8-4203-9945-5c4219d53bc7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:08.296463 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-554e5d87-9e13-4d1c-9603-e57f92ef33db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:06:08.296463 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:08.296463 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:08.296463 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:08.296463 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:08.296463 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:08.296463 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:08.296463 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:08.296463 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:08.296463 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:08.296463 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:08.296463 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:08.296463 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:06:08.296463 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:06:08.296463 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:06:08.297526 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:06:08.297526 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:08.297526 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:08.297526 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:08.297526 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:08.297526 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:08.297526 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:08.297526 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:08.297526 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:08.297526 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:08.297526 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:08.297526 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:08.297526 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:08.297526 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:08.297526 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:08.297526 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:08.297526 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:08.298648 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:06:08.298648 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:06:08.298648 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:06:08.298648 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:08.299125 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f0f78-98c8-4203-9945-5c4219d53bc7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:08.300738 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f0f78-98c8-4203-9945-5c4219d53bc7 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:08.302312 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 391/803] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:06:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:08.303157 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e5d87-9e13-4d1c-9603-e57f92ef33db None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:08.314746 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 413/804] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Jun 18 04:06:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:08.316395 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e682afe5-16c5-4f75-bd32-6cadd1718759 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:08.317010 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e682afe5-16c5-4f75-bd32-6cadd1718759 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:08.317010 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e682afe5-16c5-4f75-bd32-6cadd1718759 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:08.318417 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 414/805] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:06:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:06:08.319246 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e682afe5-16c5-4f75-bd32-6cadd1718759 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:08.408016 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e5d87-9e13-4d1c-9603-e57f92ef33db None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:08.433028 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e682afe5-16c5-4f75-bd32-6cadd1718759 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:08.443595 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9ecea-9e53-4c49-8797-67d1af121d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:08.444267 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9ecea-9e53-4c49-8797-67d1af121d47 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:08.444537 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9ecea-9e53-4c49-8797-67d1af121d47 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:08.444840 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9ecea-9e53-4c49-8797-67d1af121d47 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:08.445548 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd9ecea-9e53-4c49-8797-67d1af121d47 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:08.445852 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd9ecea-9e53-4c49-8797-67d1af121d47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:08.447280 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd9ecea-9e53-4c49-8797-67d1af121d47 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:08.456413 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 392/806] 10.222.0.20 () {56 vars in 1124 bytes} [Sat Jun 18 04:06:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:08.456413 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9ecea-9e53-4c49-8797-67d1af121d47 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:08.459283 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:08.478783 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df82de-5b2d-4980-ab42-9932566c7fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:08.479508 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df82de-5b2d-4980-ab42-9932566c7fc7 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:08.479718 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df82de-5b2d-4980-ab42-9932566c7fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:08.479994 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df82de-5b2d-4980-ab42-9932566c7fc7 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:08.480750 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89df82de-5b2d-4980-ab42-9932566c7fc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:08.481059 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89df82de-5b2d-4980-ab42-9932566c7fc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:08.482448 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89df82de-5b2d-4980-ab42-9932566c7fc7 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:08.483901 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:08.499342 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 415/807] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:06:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:08.499342 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd8d6b-aa14-4a85-843f-0a4157ad0b82 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:08.499342 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd8d6b-aa14-4a85-843f-0a4157ad0b82 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:08.499342 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd8d6b-aa14-4a85-843f-0a4157ad0b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:08.515024 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-a2fd8d6b-aa14-4a85-843f-0a4157ad0b82 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:06:08.516209 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-a2fd8d6b-aa14-4a85-843f-0a4157ad0b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:06:08.564287 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9ecea-9e53-4c49-8797-67d1af121d47 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:08.587858 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 416/808] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:06:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 04:06:08.588950 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fd8d6b-aa14-4a85-843f-0a4157ad0b82 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:08.602725 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d0361-ecb6-413f-ae6c-3f5480c901bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:08.603693 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d0361-ecb6-413f-ae6c-3f5480c901bb None admin] REQUEST_METHOD: `PUT` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:08.604034 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d0361-ecb6-413f-ae6c-3f5480c901bb None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:08.604367 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d0361-ecb6-413f-ae6c-3f5480c901bb None admin] PATH_INFO: `/v3/projects/9649aee8c5554102bc4193003300a3ad/users/310a7b366bee40f38960d76e56b52986/roles/f055a7ed241c4492a4f92494099bab54` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:08.621640 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7d0361-ecb6-413f-ae6c-3f5480c901bb None admin] RBAC: Authorizing `identity:create_grant(project_id=9649aee8c5554102bc4193003300a3ad, user_id=310a7b366bee40f38960d76e56b52986, role_id=f055a7ed241c4492a4f92494099bab54)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:08.623094 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7d0361-ecb6-413f-ae6c-3f5480c901bb None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:08.640722 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 393/809] 10.222.0.20 () {58 vars in 1439 bytes} [Sat Jun 18 04:06:08 2022] PUT /identity/v3/projects/9649aee8c5554102bc4193003300a3ad/users/310a7b366bee40f38960d76e56b52986/roles/f055a7ed241c4492a4f92494099bab54 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 04:06:08.640722 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d0361-ecb6-413f-ae6c-3f5480c901bb None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:08.722807 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fd8d6b-aa14-4a85-843f-0a4157ad0b82 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:08.734641 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:08.734827 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:08.761797 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d0361-ecb6-413f-ae6c-3f5480c901bb None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:08.767697 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85831d3-b09b-410e-8fe0-bc81eeb9a104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:08.768416 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85831d3-b09b-410e-8fe0-bc81eeb9a104 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:08.768736 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85831d3-b09b-410e-8fe0-bc81eeb9a104 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:08.769013 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85831d3-b09b-410e-8fe0-bc81eeb9a104 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:08.769804 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85831d3-b09b-410e-8fe0-bc81eeb9a104 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:08.770115 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85831d3-b09b-410e-8fe0-bc81eeb9a104 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:08.771540 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85831d3-b09b-410e-8fe0-bc81eeb9a104 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:08.782381 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 417/810] 10.222.0.20 () {56 vars in 1124 bytes} [Sat Jun 18 04:06:08 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:08.782381 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85831d3-b09b-410e-8fe0-bc81eeb9a104 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:08.809138 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be588c-c7bc-478a-a011-0c75c09fae0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:08.810330 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be588c-c7bc-478a-a011-0c75c09fae0d None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:08.810807 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be588c-c7bc-478a-a011-0c75c09fae0d None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:08.811275 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be588c-c7bc-478a-a011-0c75c09fae0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:08.819262 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02be588c-c7bc-478a-a011-0c75c09fae0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:08.821074 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02be588c-c7bc-478a-a011-0c75c09fae0d None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:08.837300 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-02be588c-c7bc-478a-a011-0c75c09fae0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 04:06:08.837300 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:08.837300 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:08.837300 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:08.837300 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:08.837300 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:08.837300 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:08.837300 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:08.837300 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:08.837300 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:08.837300 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:08.837300 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:08.837300 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 04:06:08.837300 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 04:06:08.837300 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 04:06:08.838259 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 04:06:08.838259 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:08.838259 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:08.838259 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:08.838259 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:08.838259 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:08.838259 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:08.838259 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:08.838259 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:08.838259 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:08.838259 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:08.838259 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:08.838259 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:08.838259 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:08.838259 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:08.838259 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:08.838259 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:08.839127 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 04:06:08.839127 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 04:06:08.839127 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 04:06:08.839127 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 04:06:08.839127 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 04:06:08.839127 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 04:06:08.839127 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 04:06:08.839127 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:08.841695 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 394/811] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Jun 18 04:06:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:08.842679 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be588c-c7bc-478a-a011-0c75c09fae0d None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:08.890333 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85831d3-b09b-410e-8fe0-bc81eeb9a104 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:08.927954 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f401b141-aef6-4168-85b6-a4bf52b9d521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:08.928904 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401b141-aef6-4168-85b6-a4bf52b9d521 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:08.929187 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401b141-aef6-4168-85b6-a4bf52b9d521 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:08.929461 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401b141-aef6-4168-85b6-a4bf52b9d521 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:08.940978 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f401b141-aef6-4168-85b6-a4bf52b9d521 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:06:08.949211 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-f401b141-aef6-4168-85b6-a4bf52b9d521 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 04:06:08.949211 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:08.949211 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:08.949211 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:08.949211 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:08.949211 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:08.949211 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:08.949211 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:08.949211 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:08.949211 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:08.949211 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:08.949211 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:08.949211 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:06:08.949211 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:06:08.949211 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:06:08.949211 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:06:08.950162 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:06:08.950162 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:06:08.950162 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:06:08.950162 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:06:08.950162 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:08.950162 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:08.950162 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:08.950162 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:08.950162 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:08.950162 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:08.950162 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:08.950162 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:08.950162 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:08.950162 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:08.950162 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:08.950162 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:08.951009 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:08.951009 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:08.951009 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:08.951009 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:08.951009 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:06:08.951009 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:06:08.951009 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:06:08.951009 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:06:08.951009 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:06:08.951009 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:06:08.951009 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 04:06:08.951009 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:08.951009 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 418/812] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Jun 18 04:06:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:08.951708 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f401b141-aef6-4168-85b6-a4bf52b9d521 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:08.959079 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be588c-c7bc-478a-a011-0c75c09fae0d None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:08.996791 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa18a6d-e90b-479e-947f-d4123f3c2e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:08.996975 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:08.997937 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa18a6d-e90b-479e-947f-d4123f3c2e28 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:08.998426 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa18a6d-e90b-479e-947f-d4123f3c2e28 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:08.998886 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa18a6d-e90b-479e-947f-d4123f3c2e28 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:08.999817 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa18a6d-e90b-479e-947f-d4123f3c2e28 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:09.001487 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa18a6d-e90b-479e-947f-d4123f3c2e28 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:09.008248 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:09.036886 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 395/813] 10.222.0.20 () {60 vars in 1144 bytes} [Sat Jun 18 04:06:08 2022] POST /identity/v3/endpoints => generated 346 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 04:06:09.036886 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa18a6d-e90b-479e-947f-d4123f3c2e28 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:09.132046 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f401b141-aef6-4168-85b6-a4bf52b9d521 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:09.189364 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1439a2f5-2113-48f6-8064-681df53100f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:09.190056 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439a2f5-2113-48f6-8064-681df53100f5 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:09.190334 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439a2f5-2113-48f6-8064-681df53100f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:09.190602 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439a2f5-2113-48f6-8064-681df53100f5 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:09.191408 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1439a2f5-2113-48f6-8064-681df53100f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:09.191707 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1439a2f5-2113-48f6-8064-681df53100f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:09.191806 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa18a6d-e90b-479e-947f-d4123f3c2e28 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:09.193518 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1439a2f5-2113-48f6-8064-681df53100f5 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:09.211546 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 419/814] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Jun 18 04:06:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:09.213085 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67bfa6-83e4-4d0a-b3c6-e1b9463adc1c None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:09.213372 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67bfa6-83e4-4d0a-b3c6-e1b9463adc1c None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:09.213644 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67bfa6-83e4-4d0a-b3c6-e1b9463adc1c None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:09.215429 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 420/815] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:06:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:06:09.218760 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae67bfa6-83e4-4d0a-b3c6-e1b9463adc1c None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:09.236840 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4343b0-8f69-408b-a578-9d67332dcb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:09.237518 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4343b0-8f69-408b-a578-9d67332dcb29 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:09.238155 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4343b0-8f69-408b-a578-9d67332dcb29 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:09.238155 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4343b0-8f69-408b-a578-9d67332dcb29 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:09.238809 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4343b0-8f69-408b-a578-9d67332dcb29 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:09.239112 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4343b0-8f69-408b-a578-9d67332dcb29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:09.240485 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4343b0-8f69-408b-a578-9d67332dcb29 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:09.249688 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 396/816] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Jun 18 04:06:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:09.250870 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803b954-0b1f-42fc-8ba4-0e6328246753 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:09.251153 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803b954-0b1f-42fc-8ba4-0e6328246753 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:09.251478 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803b954-0b1f-42fc-8ba4-0e6328246753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:09.267826 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-2803b954-0b1f-42fc-8ba4-0e6328246753 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:06:09.269049 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-2803b954-0b1f-42fc-8ba4-0e6328246753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:06:09.331332 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:09.343492 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:09.353716 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 397/817] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:06:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 04:06:09.354940 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803b954-0b1f-42fc-8ba4-0e6328246753 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:09.373622 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae67bfa6-83e4-4d0a-b3c6-e1b9463adc1c None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:09.412583 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0b40fc-64ea-470b-93d4-4cd78760d2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:09.413642 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b40fc-64ea-470b-93d4-4cd78760d2e7 None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:09.413988 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b40fc-64ea-470b-93d4-4cd78760d2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:09.414328 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b40fc-64ea-470b-93d4-4cd78760d2e7 None admin] PATH_INFO: `/v3/projects/9649aee8c5554102bc4193003300a3ad/users/fbfd82b05777466b97d46d376d4e11eb/roles/d783a633c75847d48ef7ef5b169b0313` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:09.416613 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0b40fc-64ea-470b-93d4-4cd78760d2e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=9649aee8c5554102bc4193003300a3ad, user_id=fbfd82b05777466b97d46d376d4e11eb, role_id=d783a633c75847d48ef7ef5b169b0313)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:09.418454 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0b40fc-64ea-470b-93d4-4cd78760d2e7 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:09.446297 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 421/818] 10.222.0.20 () {58 vars in 1439 bytes} [Sat Jun 18 04:06:09 2022] PUT /identity/v3/projects/9649aee8c5554102bc4193003300a3ad/users/fbfd82b05777466b97d46d376d4e11eb/roles/d783a633c75847d48ef7ef5b169b0313 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 04:06:09.446297 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0b40fc-64ea-470b-93d4-4cd78760d2e7 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:09.521462 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803b954-0b1f-42fc-8ba4-0e6328246753 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:09.567787 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0b40fc-64ea-470b-93d4-4cd78760d2e7 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:09.604824 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f280dea8-4071-454d-9c66-27560449a6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:09.605951 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280dea8-4071-454d-9c66-27560449a6e4 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:09.606402 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280dea8-4071-454d-9c66-27560449a6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:09.606896 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280dea8-4071-454d-9c66-27560449a6e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:09.609814 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7204b9b-c994-4b21-87b7-b64c44565dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:09.610790 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7204b9b-c994-4b21-87b7-b64c44565dc0 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:09.611136 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7204b9b-c994-4b21-87b7-b64c44565dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:09.611474 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7204b9b-c994-4b21-87b7-b64c44565dc0 None admin] PATH_INFO: `/v3/services/network` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:09.612201 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7204b9b-c994-4b21-87b7-b64c44565dc0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:09.614045 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7204b9b-c994-4b21-87b7-b64c44565dc0 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:09.629070 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-b7204b9b-c994-4b21-87b7-b64c44565dc0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 18 04:06:09.629070 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:09.629070 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 18 04:06:09.629070 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 18 04:06:09.629070 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 18 04:06:09.629070 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 18 04:06:09.629070 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 18 04:06:09.629070 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 04:06:09.629070 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 18 04:06:09.629070 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:09.629070 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 04:06:09.629070 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:09.629070 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:09.629070 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:09.629070 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:09.629070 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:09.629070 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:09.630128 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:09.630128 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:09.630128 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:09.630128 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:09.630128 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:09.630128 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:09.630128 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 18 04:06:09.630128 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 18 04:06:09.630128 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 18 04:06:09.630128 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 18 04:06:09.630128 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:09.630128 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:09.630128 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:09.630128 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:09.630128 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:09.630128 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:09.630959 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:09.630959 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:09.630959 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:09.630959 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:09.630959 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:09.630959 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:09.630959 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:09.630959 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:09.630959 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:09.630959 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:09.630959 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 18 04:06:09.630959 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 04:06:09.630959 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 18 04:06:09.630959 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:09.630959 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 422/819] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Jun 18 04:06:09 2022] GET /identity/v3/services/network => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:09.636641 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f280dea8-4071-454d-9c66-27560449a6e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:09.637105 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7204b9b-c994-4b21-87b7-b64c44565dc0 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:09.638592 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f280dea8-4071-454d-9c66-27560449a6e4 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:09.658325 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:09.680646 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-f280dea8-4071-454d-9c66-27560449a6e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:06:09.680646 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:09.680646 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:09.680646 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:09.680646 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:09.680646 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:09.680646 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:09.680646 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:09.680646 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:09.680646 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:09.680646 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:09.680646 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:09.680646 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:06:09.680646 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:06:09.680646 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:06:09.681633 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:06:09.681633 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:09.681633 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:09.681633 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:09.681633 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:09.681633 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:09.681633 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:09.681633 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:09.681633 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:09.681633 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:09.681633 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:09.681633 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:09.681633 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:09.681633 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:09.681633 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:09.681633 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:09.681633 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:09.682608 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:06:09.682608 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:06:09.682608 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:06:09.682608 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:09.683272 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 398/820] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:06:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:09.689840 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f280dea8-4071-454d-9c66-27560449a6e4 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:09.739689 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:09.821714 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7204b9b-c994-4b21-87b7-b64c44565dc0 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:09.837517 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f280dea8-4071-454d-9c66-27560449a6e4 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:09.879138 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb66a0b-9f72-4d34-917e-71d1b57f7b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:09.879804 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb66a0b-9f72-4d34-917e-71d1b57f7b09 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:09.880081 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb66a0b-9f72-4d34-917e-71d1b57f7b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:09.880346 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb66a0b-9f72-4d34-917e-71d1b57f7b09 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:09.881094 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb66a0b-9f72-4d34-917e-71d1b57f7b09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:09.881394 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb66a0b-9f72-4d34-917e-71d1b57f7b09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:09.882769 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb66a0b-9f72-4d34-917e-71d1b57f7b09 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:09.900626 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab3ef2-2184-490d-b9a1-878362163b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:09.901303 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab3ef2-2184-490d-b9a1-878362163b13 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:09.901574 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab3ef2-2184-490d-b9a1-878362163b13 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:09.901841 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab3ef2-2184-490d-b9a1-878362163b13 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:09.902542 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ab3ef2-2184-490d-b9a1-878362163b13 None admin] RBAC: Adding query filter params (name=network) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:09.902840 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ab3ef2-2184-490d-b9a1-878362163b13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:09.904208 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ab3ef2-2184-490d-b9a1-878362163b13 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:09.908181 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 399/821] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:06:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:06:09.914433 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb66a0b-9f72-4d34-917e-71d1b57f7b09 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:09.919206 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 423/822] 10.222.0.20 () {56 vars in 1112 bytes} [Sat Jun 18 04:06:09 2022] GET /identity/v3/services?name=network => generated 124 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:06:09.921961 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab3ef2-2184-490d-b9a1-878362163b13 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:10.022034 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:10.046663 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab3ef2-2184-490d-b9a1-878362163b13 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:10.070056 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:10.081292 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0132bd38-3518-4c79-988b-26337b00bbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:10.081999 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132bd38-3518-4c79-988b-26337b00bbbb None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:10.082377 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132bd38-3518-4c79-988b-26337b00bbbb None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:10.082744 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132bd38-3518-4c79-988b-26337b00bbbb None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:10.083552 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0132bd38-3518-4c79-988b-26337b00bbbb None admin] RBAC: Adding query filter params (type=network) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:10.083954 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0132bd38-3518-4c79-988b-26337b00bbbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:10.085462 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0132bd38-3518-4c79-988b-26337b00bbbb None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:10.088848 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb66a0b-9f72-4d34-917e-71d1b57f7b09 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:10.090920 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 424/823] 10.222.0.20 () {56 vars in 1112 bytes} [Sat Jun 18 04:06:09 2022] GET /identity/v3/services?type=network => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:10.096311 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0132bd38-3518-4c79-988b-26337b00bbbb None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:10.197475 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0132bd38-3518-4c79-988b-26337b00bbbb None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:10.221362 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54262984-a19b-4b9f-a19f-c83e3cb424fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:10.222181 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54262984-a19b-4b9f-a19f-c83e3cb424fc None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:10.222448 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54262984-a19b-4b9f-a19f-c83e3cb424fc None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:10.222713 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54262984-a19b-4b9f-a19f-c83e3cb424fc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:10.232770 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab2601c-44c0-41f1-96d6-8285ed647c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:10.233541 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2601c-44c0-41f1-96d6-8285ed647c17 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:10.233888 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2601c-44c0-41f1-96d6-8285ed647c17 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:10.234597 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2601c-44c0-41f1-96d6-8285ed647c17 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:10.235409 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab2601c-44c0-41f1-96d6-8285ed647c17 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:10.236880 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab2601c-44c0-41f1-96d6-8285ed647c17 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:10.244114 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54262984-a19b-4b9f-a19f-c83e3cb424fc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:10.245646 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54262984-a19b-4b9f-a19f-c83e3cb424fc None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:10.248976 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:10.273068 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 425/824] 10.222.0.20 () {60 vars in 1144 bytes} [Sat Jun 18 04:06:10 2022] POST /identity/v3/endpoints => generated 327 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 04:06:10.279308 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-54262984-a19b-4b9f-a19f-c83e3cb424fc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 18 04:06:10.279308 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:10.279308 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:10.279308 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:10.279308 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:10.279308 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:10.279308 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:10.279308 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:10.279308 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:10.279308 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:10.279308 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:10.279308 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:10.279308 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 04:06:10.279308 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 04:06:10.279308 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 04:06:10.279308 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 04:06:10.280420 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:10.280420 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:10.280420 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 04:06:10.280420 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 04:06:10.280420 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 04:06:10.280420 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 04:06:10.280420 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:10.280420 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:10.280420 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:10.280420 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:10.280420 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:10.280420 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:10.280420 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:10.280420 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:10.280420 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:10.280420 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:10.280420 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:10.280420 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:10.281658 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:10.281658 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:10.281658 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 04:06:10.281658 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 04:06:10.281658 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 04:06:10.281658 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 04:06:10.281658 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 04:06:10.281658 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 04:06:10.281658 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 18 04:06:10.281658 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:10.284026 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 400/825] 10.222.0.20 () {56 vars in 1093 bytes} [Sat Jun 18 04:06:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 04:06:10.289863 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab2601c-44c0-41f1-96d6-8285ed647c17 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:10.440314 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab2601c-44c0-41f1-96d6-8285ed647c17 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:10.490288 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a725b94e-1757-4a13-b848-6ecdc55bc7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:10.491000 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725b94e-1757-4a13-b848-6ecdc55bc7f8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:10.491277 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725b94e-1757-4a13-b848-6ecdc55bc7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:10.491546 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725b94e-1757-4a13-b848-6ecdc55bc7f8 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:10.493761 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a725b94e-1757-4a13-b848-6ecdc55bc7f8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:10.493761 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a725b94e-1757-4a13-b848-6ecdc55bc7f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:10.495836 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a725b94e-1757-4a13-b848-6ecdc55bc7f8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:10.515006 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 426/826] 10.222.0.20 () {56 vars in 1133 bytes} [Sat Jun 18 04:06:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:10.520381 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54262984-a19b-4b9f-a19f-c83e3cb424fc None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:10.638165 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54262984-a19b-4b9f-a19f-c83e3cb424fc None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:10.675208 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca624e-fdad-4a72-b6be-d8de3b4886b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:10.676197 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca624e-fdad-4a72-b6be-d8de3b4886b6 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:10.676676 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca624e-fdad-4a72-b6be-d8de3b4886b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:10.677119 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca624e-fdad-4a72-b6be-d8de3b4886b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:10.704884 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:10.749960 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca624e-fdad-4a72-b6be-d8de3b4886b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:10.751405 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca624e-fdad-4a72-b6be-d8de3b4886b6 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:10.846381 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683b341-7980-4b93-9871-e1be587e8dd0 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:10.846911 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683b341-7980-4b93-9871-e1be587e8dd0 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:10.847143 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683b341-7980-4b93-9871-e1be587e8dd0 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:10.848924 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 427/827] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:06:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 18 04:06:10.854004 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dccf92-8db2-4b35-aaef-889e0b935d0e None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:10.854390 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dccf92-8db2-4b35-aaef-889e0b935d0e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:10.854783 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dccf92-8db2-4b35-aaef-889e0b935d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:10.860798 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 401/828] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Jun 18 04:06:10 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 18 04:06:10.863580 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca624e-fdad-4a72-b6be-d8de3b4886b6 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:10.875304 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-b2dccf92-8db2-4b35-aaef-889e0b935d0e None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:06:10.876905 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-b2dccf92-8db2-4b35-aaef-889e0b935d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:06:10.929053 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:10.930441 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:10.953377 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 428/829] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:06:10 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 18 04:06:10.980527 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dccf92-8db2-4b35-aaef-889e0b935d0e None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:10.985914 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca624e-fdad-4a72-b6be-d8de3b4886b6 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:11.029233 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8fde2d-a0d4-4311-8961-68968319d71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:11.030343 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fde2d-a0d4-4311-8961-68968319d71c None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:11.031233 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fde2d-a0d4-4311-8961-68968319d71c None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:11.031709 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fde2d-a0d4-4311-8961-68968319d71c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:11.045436 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8fde2d-a0d4-4311-8961-68968319d71c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:11.047784 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8fde2d-a0d4-4311-8961-68968319d71c None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:11.095112 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dccf92-8db2-4b35-aaef-889e0b935d0e None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:11.140316 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606bd851-8936-44dd-b255-5c0d6704bb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:11.141527 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606bd851-8936-44dd-b255-5c0d6704bb4b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:11.142000 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606bd851-8936-44dd-b255-5c0d6704bb4b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:11.142458 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606bd851-8936-44dd-b255-5c0d6704bb4b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:11.155443 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606bd851-8936-44dd-b255-5c0d6704bb4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:06:11.163819 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-606bd851-8936-44dd-b255-5c0d6704bb4b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 18 04:06:11.163819 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:11.163819 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:11.163819 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:11.163819 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:11.163819 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:11.163819 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:11.163819 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:11.163819 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:11.163819 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:11.163819 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:11.163819 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:11.163819 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:06:11.163819 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:06:11.163819 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:06:11.163819 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:06:11.164926 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:06:11.164926 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:06:11.164926 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:06:11.164926 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:06:11.164926 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:11.164926 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:11.164926 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:11.164926 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:11.164926 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:11.164926 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:11.164926 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:11.164926 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:11.164926 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:11.164926 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:11.164926 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:11.164926 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:11.165804 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:11.165804 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:11.165804 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:11.165804 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:11.165804 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:06:11.165804 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:06:11.165804 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:06:11.165804 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:06:11.165804 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:06:11.165804 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:06:11.165804 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 18 04:06:11.165804 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:11.168623 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 429/830] 10.222.0.20 () {56 vars in 1102 bytes} [Sat Jun 18 04:06:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 04:06:11.174334 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606bd851-8936-44dd-b255-5c0d6704bb4b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:11.206237 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-ea8fde2d-a0d4-4311-8961-68968319d71c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:06:11.206237 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:11.206237 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:11.206237 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:11.206237 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:11.206237 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:11.206237 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:11.206237 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:11.206237 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:11.206237 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:11.206237 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:11.206237 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:11.206237 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:06:11.206237 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:06:11.206237 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:06:11.207745 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:06:11.207745 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:11.207745 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:11.207745 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:11.207745 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:11.207745 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:11.207745 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:11.207745 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:11.207745 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:11.207745 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:11.207745 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:11.207745 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:11.207745 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:11.207745 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:11.207745 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:11.207745 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:11.207745 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:11.208961 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:06:11.208961 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:06:11.208961 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:06:11.208961 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:11.211055 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 402/831] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:06:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:11.220730 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8fde2d-a0d4-4311-8961-68968319d71c None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:11.329353 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8fde2d-a0d4-4311-8961-68968319d71c None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:11.339042 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:11.363991 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:11.368220 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630640f3-df9c-4713-84bf-5367191edfae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:11.369523 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630640f3-df9c-4713-84bf-5367191edfae None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:11.369805 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630640f3-df9c-4713-84bf-5367191edfae None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:11.370077 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630640f3-df9c-4713-84bf-5367191edfae None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:11.371046 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630640f3-df9c-4713-84bf-5367191edfae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:11.371356 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630640f3-df9c-4713-84bf-5367191edfae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:11.372759 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630640f3-df9c-4713-84bf-5367191edfae None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:11.390082 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 403/832] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:06:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:11.391890 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630640f3-df9c-4713-84bf-5367191edfae None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:11.439083 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606bd851-8936-44dd-b255-5c0d6704bb4b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:11.474772 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd262d7-3fd4-4f40-b495-63ac23226932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:11.475373 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd262d7-3fd4-4f40-b495-63ac23226932 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:11.475649 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd262d7-3fd4-4f40-b495-63ac23226932 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:11.475917 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd262d7-3fd4-4f40-b495-63ac23226932 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:11.476697 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd262d7-3fd4-4f40-b495-63ac23226932 None admin] RBAC: Adding query filter params (name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:11.477003 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd262d7-3fd4-4f40-b495-63ac23226932 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:11.478451 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd262d7-3fd4-4f40-b495-63ac23226932 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:11.487078 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 430/833] 10.222.0.20 () {56 vars in 1103 bytes} [Sat Jun 18 04:06:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:06:11.488336 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b9b48-73b1-4921-a968-11ac61c0222e None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:11.488637 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b9b48-73b1-4921-a968-11ac61c0222e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:11.488912 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b9b48-73b1-4921-a968-11ac61c0222e None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:11.490280 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 431/834] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:06:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:06:11.495351 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30b9b48-73b1-4921-a968-11ac61c0222e None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:11.508498 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630640f3-df9c-4713-84bf-5367191edfae None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:11.544660 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86657351-fdf7-4e46-a5aa-bf0572462020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:11.545869 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86657351-fdf7-4e46-a5aa-bf0572462020 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:11.546146 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86657351-fdf7-4e46-a5aa-bf0572462020 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:11.546359 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86657351-fdf7-4e46-a5aa-bf0572462020 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:11.553562 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86657351-fdf7-4e46-a5aa-bf0572462020 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:11.554946 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86657351-fdf7-4e46-a5aa-bf0572462020 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:11.569278 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-86657351-fdf7-4e46-a5aa-bf0572462020 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 04:06:11.569278 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:11.569278 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:11.569278 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:11.569278 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:11.569278 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:11.569278 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:11.569278 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:11.569278 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:11.569278 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:11.569278 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:11.569278 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:11.569278 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 04:06:11.569278 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 04:06:11.569278 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 04:06:11.570130 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 04:06:11.570130 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:11.570130 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:11.570130 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:11.570130 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:11.570130 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:11.570130 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:11.570130 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:11.570130 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:11.570130 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:11.570130 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:11.570130 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:11.570130 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:11.570130 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:11.570130 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:11.570130 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:11.570130 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:11.575769 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 04:06:11.575769 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 04:06:11.575769 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 04:06:11.575769 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 04:06:11.575769 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 04:06:11.575769 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 04:06:11.575769 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 04:06:11.575769 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:11.575769 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 404/835] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Jun 18 04:06:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:11.575769 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9432de06-6945-4ea9-af7a-0b376fd438e7 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:11.575769 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9432de06-6945-4ea9-af7a-0b376fd438e7 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:11.576350 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9432de06-6945-4ea9-af7a-0b376fd438e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:11.591122 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-9432de06-6945-4ea9-af7a-0b376fd438e7 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:06:11.592287 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-9432de06-6945-4ea9-af7a-0b376fd438e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:06:11.603460 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30b9b48-73b1-4921-a968-11ac61c0222e None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:11.605393 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:11.617960 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:11.642021 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df4c2a1-23a6-44f4-8dba-31c5d9cf3f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:11.642840 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df4c2a1-23a6-44f4-8dba-31c5d9cf3f2b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:11.643111 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df4c2a1-23a6-44f4-8dba-31c5d9cf3f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:11.643379 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df4c2a1-23a6-44f4-8dba-31c5d9cf3f2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:11.653254 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df4c2a1-23a6-44f4-8dba-31c5d9cf3f2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:11.654718 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df4c2a1-23a6-44f4-8dba-31c5d9cf3f2b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:11.665184 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 405/836] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:06:11 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 04:06:11.666308 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9432de06-6945-4ea9-af7a-0b376fd438e7 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:11.672121 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-9df4c2a1-23a6-44f4-8dba-31c5d9cf3f2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:06:11.672121 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:11.672121 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:11.672121 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:11.672121 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:11.672121 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:11.672121 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:11.672121 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:11.672121 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:11.672121 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:11.672121 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:11.672121 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:11.672121 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:06:11.672121 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:06:11.672121 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:06:11.673201 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:06:11.673201 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:11.673201 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:11.673201 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:11.673201 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:11.673201 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:11.673201 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:11.673201 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:11.673201 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:11.673201 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:11.673201 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:11.673201 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:11.673201 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:11.673201 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:11.673201 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:11.673201 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:11.673201 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:11.674440 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:06:11.674440 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:06:11.674440 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:06:11.674440 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:11.674440 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 432/837] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:06:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:11.681536 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df4c2a1-23a6-44f4-8dba-31c5d9cf3f2b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:11.786366 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9432de06-6945-4ea9-af7a-0b376fd438e7 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:11.794620 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df4c2a1-23a6-44f4-8dba-31c5d9cf3f2b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:11.820716 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cf3e2b-c9c5-4062-b018-c756ebc3e458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:11.821404 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf3e2b-c9c5-4062-b018-c756ebc3e458 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:11.821680 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf3e2b-c9c5-4062-b018-c756ebc3e458 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:11.821948 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf3e2b-c9c5-4062-b018-c756ebc3e458 None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:11.822730 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cf3e2b-c9c5-4062-b018-c756ebc3e458 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:11.823034 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cf3e2b-c9c5-4062-b018-c756ebc3e458 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:11.824468 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cf3e2b-c9c5-4062-b018-c756ebc3e458 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:11.831227 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c4a5e-b891-436c-90f6-fe3ebf0639c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:11.831849 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c4a5e-b891-436c-90f6-fe3ebf0639c6 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:11.832126 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c4a5e-b891-436c-90f6-fe3ebf0639c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:11.832391 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c4a5e-b891-436c-90f6-fe3ebf0639c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:11.833311 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c4a5e-b891-436c-90f6-fe3ebf0639c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:11.833610 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c4a5e-b891-436c-90f6-fe3ebf0639c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:11.834963 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c4a5e-b891-436c-90f6-fe3ebf0639c6 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:11.835895 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 406/838] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Jun 18 04:06:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:11.836765 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cf3e2b-c9c5-4062-b018-c756ebc3e458 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:11.855741 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 433/839] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:06:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:11.855741 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ea474-4fca-4ae2-93e9-14145246f8ce None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:11.855741 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ea474-4fca-4ae2-93e9-14145246f8ce None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:11.855741 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ea474-4fca-4ae2-93e9-14145246f8ce None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:11.855741 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 434/840] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:06:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:06:11.855741 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ea474-4fca-4ae2-93e9-14145246f8ce None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:11.857076 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:11.874346 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:11.937311 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cf3e2b-c9c5-4062-b018-c756ebc3e458 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:11.961896 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ea474-4fca-4ae2-93e9-14145246f8ce None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:11.972011 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ee43c-575e-4ed9-a2d5-801dd3f80d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:11.972843 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ee43c-575e-4ed9-a2d5-801dd3f80d2a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:11.973122 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ee43c-575e-4ed9-a2d5-801dd3f80d2a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:11.973390 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ee43c-575e-4ed9-a2d5-801dd3f80d2a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:11.974042 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16ee43c-575e-4ed9-a2d5-801dd3f80d2a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:11.975411 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16ee43c-575e-4ed9-a2d5-801dd3f80d2a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:11.988133 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-a16ee43c-575e-4ed9-a2d5-801dd3f80d2a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 18 04:06:11.988133 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:11.988133 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 18 04:06:11.988133 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 18 04:06:11.988133 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 18 04:06:11.988133 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 18 04:06:11.988133 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 18 04:06:11.988133 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 04:06:11.988133 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 18 04:06:11.988133 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:11.988133 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 04:06:11.988133 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:11.988133 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:11.988133 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:11.988133 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:11.988133 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:11.988133 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:11.989217 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:11.989217 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:11.989217 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:11.989217 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:11.989217 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:11.989217 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:11.989217 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 18 04:06:11.989217 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 18 04:06:11.989217 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 18 04:06:11.989217 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 18 04:06:11.989217 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:11.989217 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:11.989217 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:11.989217 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:11.989217 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:11.989217 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:11.990054 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:11.990054 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:11.990054 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:11.990054 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:11.990054 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:11.990054 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:11.990054 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:11.990054 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:11.990054 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:11.990054 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:11.990054 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 18 04:06:11.990054 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 04:06:11.990054 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 18 04:06:11.990054 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:11.990054 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 407/841] 10.222.0.20 () {56 vars in 1114 bytes} [Sat Jun 18 04:06:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:11.990823 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ee43c-575e-4ed9-a2d5-801dd3f80d2a None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:11.997902 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8783efad-619d-4f07-ba53-66bc809fc5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:11.998554 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783efad-619d-4f07-ba53-66bc809fc5eb None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:11.998829 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783efad-619d-4f07-ba53-66bc809fc5eb None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:11.999097 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783efad-619d-4f07-ba53-66bc809fc5eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:11.999913 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8783efad-619d-4f07-ba53-66bc809fc5eb None admin] RBAC: Adding query filter params (role.id=d783a633c75847d48ef7ef5b169b0313, scope.project.id=9649aee8c5554102bc4193003300a3ad, user.id=c129f3de2bb2431593fac649fd4975b3) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:12.000215 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8783efad-619d-4f07-ba53-66bc809fc5eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:12.001651 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8783efad-619d-4f07-ba53-66bc809fc5eb None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:12.007683 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 435/842] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Jun 18 04:06:11 2022] GET /identity/v3/role_assignments?user.id=c129f3de2bb2431593fac649fd4975b3&scope.project.id=9649aee8c5554102bc4193003300a3ad&role.id=d783a633c75847d48ef7ef5b169b0313 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:12.008780 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524fb5fe-3297-43b1-8963-f49dfc45636b None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:12.009062 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524fb5fe-3297-43b1-8963-f49dfc45636b None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:12.009329 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524fb5fe-3297-43b1-8963-f49dfc45636b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:12.039618 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-524fb5fe-3297-43b1-8963-f49dfc45636b None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:06:12.040787 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-524fb5fe-3297-43b1-8963-f49dfc45636b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:06:12.082762 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:12.109490 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ee43c-575e-4ed9-a2d5-801dd3f80d2a None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:12.122099 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 436/843] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:06:12 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 04:06:12.122797 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524fb5fe-3297-43b1-8963-f49dfc45636b None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:12.146957 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:12.151053 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a650a39-f876-4d8c-a743-86d26c64447d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:12.151972 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a650a39-f876-4d8c-a743-86d26c64447d None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:12.152181 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a650a39-f876-4d8c-a743-86d26c64447d None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:12.152424 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a650a39-f876-4d8c-a743-86d26c64447d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:12.160965 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a650a39-f876-4d8c-a743-86d26c64447d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:12.162422 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a650a39-f876-4d8c-a743-86d26c64447d None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:12.178636 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-0a650a39-f876-4d8c-a743-86d26c64447d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 18 04:06:12.178636 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:12.178636 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:12.178636 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:12.178636 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:12.178636 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:12.178636 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:12.178636 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:12.178636 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:12.178636 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:12.178636 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:12.178636 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:12.178636 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 04:06:12.178636 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 04:06:12.178636 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 04:06:12.178636 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 04:06:12.179606 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:12.179606 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:12.179606 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 04:06:12.179606 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 04:06:12.179606 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 04:06:12.179606 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 04:06:12.179606 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:12.179606 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:12.179606 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:12.179606 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:12.179606 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:12.179606 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:12.179606 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:12.179606 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:12.179606 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:12.179606 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:12.179606 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:12.179606 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:12.180625 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:12.180625 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:12.180625 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 04:06:12.180625 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 04:06:12.180625 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 04:06:12.180625 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 04:06:12.180625 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 04:06:12.180625 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 04:06:12.180625 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 18 04:06:12.180625 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:12.180625 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 408/844] 10.222.0.20 () {56 vars in 1117 bytes} [Sat Jun 18 04:06:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:12.180625 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a650a39-f876-4d8c-a743-86d26c64447d None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:12.253562 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524fb5fe-3297-43b1-8963-f49dfc45636b None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:12.288175 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682aabe1-c109-4eb3-8c29-9769e50f3da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:12.288871 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682aabe1-c109-4eb3-8c29-9769e50f3da2 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:12.289147 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682aabe1-c109-4eb3-8c29-9769e50f3da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:12.289409 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682aabe1-c109-4eb3-8c29-9769e50f3da2 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:12.290236 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682aabe1-c109-4eb3-8c29-9769e50f3da2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:12.290480 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682aabe1-c109-4eb3-8c29-9769e50f3da2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:12.291839 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682aabe1-c109-4eb3-8c29-9769e50f3da2 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:12.292813 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a650a39-f876-4d8c-a743-86d26c64447d None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:12.302209 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 437/845] 10.222.0.20 () {56 vars in 1114 bytes} [Sat Jun 18 04:06:12 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:12.302209 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682aabe1-c109-4eb3-8c29-9769e50f3da2 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:12.327701 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70b503-bd5d-45a2-8c23-847653810eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:12.328489 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70b503-bd5d-45a2-8c23-847653810eab None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:12.328796 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70b503-bd5d-45a2-8c23-847653810eab None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:12.329065 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70b503-bd5d-45a2-8c23-847653810eab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:12.339183 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c70b503-bd5d-45a2-8c23-847653810eab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:06:12.346689 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-3c70b503-bd5d-45a2-8c23-847653810eab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 04:06:12.346689 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:12.346689 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:12.346689 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:12.346689 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:12.346689 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:12.346689 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:12.346689 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:12.346689 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:12.346689 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:12.346689 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:12.346689 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:12.346689 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:06:12.346689 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:06:12.346689 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:06:12.346689 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:06:12.347640 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:06:12.347640 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:06:12.347640 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:06:12.347640 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:06:12.347640 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:12.347640 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:12.347640 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:12.347640 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:12.347640 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:12.347640 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:12.347640 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:12.347640 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:12.347640 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:12.347640 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:12.347640 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:12.347640 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:12.348474 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:12.348474 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:12.348474 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:12.348474 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:12.348474 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:06:12.348474 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:06:12.348474 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:06:12.348474 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:06:12.348474 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:06:12.348474 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:06:12.348474 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 04:06:12.348474 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:12.348474 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 409/846] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Jun 18 04:06:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:12.349229 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70b503-bd5d-45a2-8c23-847653810eab None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:12.355897 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:12.383447 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:12.416142 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682aabe1-c109-4eb3-8c29-9769e50f3da2 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:12.452640 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f840ec-1516-4034-9f27-4694be93ff4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:12.453311 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f840ec-1516-4034-9f27-4694be93ff4e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:12.453588 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f840ec-1516-4034-9f27-4694be93ff4e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:12.453847 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f840ec-1516-4034-9f27-4694be93ff4e None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:12.454162 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70b503-bd5d-45a2-8c23-847653810eab None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:12.454671 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f840ec-1516-4034-9f27-4694be93ff4e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:12.454972 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f840ec-1516-4034-9f27-4694be93ff4e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:12.456622 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f840ec-1516-4034-9f27-4694be93ff4e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:12.474609 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 438/847] 10.222.0.20 () {56 vars in 1149 bytes} [Sat Jun 18 04:06:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:12.475426 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f840ec-1516-4034-9f27-4694be93ff4e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:12.496036 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7176ba3-f71d-4f46-9087-3b20781f76e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:12.496724 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7176ba3-f71d-4f46-9087-3b20781f76e4 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:12.496999 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7176ba3-f71d-4f46-9087-3b20781f76e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:12.497802 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7176ba3-f71d-4f46-9087-3b20781f76e4 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:12.497935 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7176ba3-f71d-4f46-9087-3b20781f76e4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:12.498225 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7176ba3-f71d-4f46-9087-3b20781f76e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:12.499586 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7176ba3-f71d-4f46-9087-3b20781f76e4 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:12.504231 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 410/848] 10.222.0.20 () {56 vars in 1114 bytes} [Sat Jun 18 04:06:12 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:12.505111 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7176ba3-f71d-4f46-9087-3b20781f76e4 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:12.596814 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f840ec-1516-4034-9f27-4694be93ff4e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:12.598799 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:12.636030 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:12.642946 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80cbdce-01c0-4960-a717-ff229ffa6d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:12.643625 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80cbdce-01c0-4960-a717-ff229ffa6d26 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:12.643897 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80cbdce-01c0-4960-a717-ff229ffa6d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:12.644162 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80cbdce-01c0-4960-a717-ff229ffa6d26 None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:12.645015 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80cbdce-01c0-4960-a717-ff229ffa6d26 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:12.645122 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7176ba3-f71d-4f46-9087-3b20781f76e4 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:12.645312 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80cbdce-01c0-4960-a717-ff229ffa6d26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:12.646713 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80cbdce-01c0-4960-a717-ff229ffa6d26 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:12.661528 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 439/849] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Jun 18 04:06:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:12.662520 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80cbdce-01c0-4960-a717-ff229ffa6d26 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:12.683018 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cde355-8c35-4e95-a516-9f3da0c2f942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:12.683994 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cde355-8c35-4e95-a516-9f3da0c2f942 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:12.684444 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cde355-8c35-4e95-a516-9f3da0c2f942 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:12.684966 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cde355-8c35-4e95-a516-9f3da0c2f942 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:12.778744 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cde355-8c35-4e95-a516-9f3da0c2f942 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:12.781187 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cde355-8c35-4e95-a516-9f3da0c2f942 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:12.782794 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80cbdce-01c0-4960-a717-ff229ffa6d26 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:12.822454 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf2c98-8ec8-4919-bc22-037496c7ed1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:12.823598 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf2c98-8ec8-4919-bc22-037496c7ed1e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:12.824031 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf2c98-8ec8-4919-bc22-037496c7ed1e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:12.824454 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf2c98-8ec8-4919-bc22-037496c7ed1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:12.836668 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acf2c98-8ec8-4919-bc22-037496c7ed1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:12.838557 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acf2c98-8ec8-4919-bc22-037496c7ed1e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:12.856203 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:12.858369 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-7acf2c98-8ec8-4919-bc22-037496c7ed1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:06:12.858369 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:12.858369 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:12.858369 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:12.858369 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:12.858369 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:12.858369 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:12.858369 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:12.858369 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:12.858369 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:12.858369 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:12.858369 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:12.858369 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:06:12.858369 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:06:12.858369 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:06:12.859915 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:06:12.859915 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:12.859915 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:12.859915 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:12.859915 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:12.859915 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:12.859915 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:12.859915 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:12.859915 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:12.859915 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:12.859915 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:12.859915 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:12.859915 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:12.859915 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:12.859915 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:12.859915 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:12.859915 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:12.863055 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:06:12.863055 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:06:12.863055 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:06:12.863055 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:12.863055 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 440/850] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:06:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:12.871575 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf2c98-8ec8-4919-bc22-037496c7ed1e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:12.909751 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 411/851] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Jun 18 04:06:12 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 18 04:06:12.917064 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cde355-8c35-4e95-a516-9f3da0c2f942 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:12.924109 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:12.995865 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf2c98-8ec8-4919-bc22-037496c7ed1e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:13.032523 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f60854-7092-4234-a65c-2dab8d62a203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:13.033360 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f60854-7092-4234-a65c-2dab8d62a203 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:13.033738 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f60854-7092-4234-a65c-2dab8d62a203 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:13.034111 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f60854-7092-4234-a65c-2dab8d62a203 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:13.034949 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f60854-7092-4234-a65c-2dab8d62a203 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:13.035351 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f60854-7092-4234-a65c-2dab8d62a203 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:13.037026 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f60854-7092-4234-a65c-2dab8d62a203 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:13.047609 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cde355-8c35-4e95-a516-9f3da0c2f942 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:13.049779 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 441/852] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:06:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:13.057584 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f60854-7092-4234-a65c-2dab8d62a203 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:13.089691 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0883967e-954d-4891-a4e8-07dd967719be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:13.090874 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883967e-954d-4891-a4e8-07dd967719be None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:13.091290 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883967e-954d-4891-a4e8-07dd967719be None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:13.091695 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883967e-954d-4891-a4e8-07dd967719be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:13.103062 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0883967e-954d-4891-a4e8-07dd967719be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:13.104839 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0883967e-954d-4891-a4e8-07dd967719be None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:13.124320 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-0883967e-954d-4891-a4e8-07dd967719be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:06:13.124320 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:13.124320 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:13.124320 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:13.124320 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:13.124320 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:13.124320 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:13.124320 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:13.124320 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:13.124320 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:13.124320 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:13.124320 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:13.124320 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:06:13.124320 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:06:13.124320 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:06:13.125441 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:06:13.125441 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:13.125441 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:13.125441 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:13.125441 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:13.125441 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:13.125441 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:13.125441 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:13.125441 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:13.125441 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:13.125441 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:13.125441 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:13.125441 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:13.125441 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:13.125441 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:13.125441 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:13.125441 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:13.126543 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:06:13.126543 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:06:13.126543 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:06:13.126543 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:13.128493 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 412/853] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:06:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:13.133749 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0883967e-954d-4891-a4e8-07dd967719be None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:13.155622 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:13.163990 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f60854-7092-4234-a65c-2dab8d62a203 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:13.167331 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:13.202067 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671fd45c-ebd6-4103-b958-e5af385ba65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:13.202967 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fd45c-ebd6-4103-b958-e5af385ba65e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:13.203246 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fd45c-ebd6-4103-b958-e5af385ba65e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:13.203510 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fd45c-ebd6-4103-b958-e5af385ba65e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:13.211408 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671fd45c-ebd6-4103-b958-e5af385ba65e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:13.213043 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671fd45c-ebd6-4103-b958-e5af385ba65e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:13.228426 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-671fd45c-ebd6-4103-b958-e5af385ba65e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 18 04:06:13.228426 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:13.228426 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:13.228426 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:13.228426 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:13.228426 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:13.228426 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:13.228426 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:13.228426 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:13.228426 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:13.228426 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:13.228426 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:13.228426 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 04:06:13.228426 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 04:06:13.228426 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 04:06:13.228426 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 04:06:13.229670 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:13.229670 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:13.229670 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 04:06:13.229670 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 04:06:13.229670 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 04:06:13.229670 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 04:06:13.229670 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:13.229670 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:13.229670 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:13.229670 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:13.229670 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:13.229670 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:13.229670 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:13.229670 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:13.229670 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:13.229670 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:13.229670 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:13.229670 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:13.230874 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:13.230874 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:13.230874 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 04:06:13.230874 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 04:06:13.230874 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 04:06:13.230874 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 04:06:13.230874 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 04:06:13.230874 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 04:06:13.230874 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 18 04:06:13.230874 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:13.234628 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 442/854] 10.222.0.20 () {56 vars in 1096 bytes} [Sat Jun 18 04:06:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:13.235543 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671fd45c-ebd6-4103-b958-e5af385ba65e None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:13.251086 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0883967e-954d-4891-a4e8-07dd967719be None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:13.287617 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f1bf6-7b34-43f0-b3ac-504b014e08d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:13.288647 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f1bf6-7b34-43f0-b3ac-504b014e08d8 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:13.289087 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f1bf6-7b34-43f0-b3ac-504b014e08d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:13.289531 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f1bf6-7b34-43f0-b3ac-504b014e08d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:13.290661 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7f1bf6-7b34-43f0-b3ac-504b014e08d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:13.291097 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7f1bf6-7b34-43f0-b3ac-504b014e08d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:13.292704 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7f1bf6-7b34-43f0-b3ac-504b014e08d8 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:13.305758 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 413/855] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:06:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:13.310763 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f1bf6-7b34-43f0-b3ac-504b014e08d8 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:13.340519 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671fd45c-ebd6-4103-b958-e5af385ba65e None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:13.377266 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e6819-6d79-49a4-bfc1-ad443396225c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:13.377845 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e6819-6d79-49a4-bfc1-ad443396225c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:13.378128 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e6819-6d79-49a4-bfc1-ad443396225c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:13.378669 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e6819-6d79-49a4-bfc1-ad443396225c None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:13.379398 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e6819-6d79-49a4-bfc1-ad443396225c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:13.379637 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e6819-6d79-49a4-bfc1-ad443396225c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:13.381107 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e6819-6d79-49a4-bfc1-ad443396225c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:13.396238 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:13.401361 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 443/856] 10.222.0.20 () {56 vars in 1135 bytes} [Sat Jun 18 04:06:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:13.407015 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e6819-6d79-49a4-bfc1-ad443396225c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:13.427851 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f1bf6-7b34-43f0-b3ac-504b014e08d8 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:13.438602 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:13.467223 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d9abba-325e-4e6a-bbf6-d258bb149be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:13.468355 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9abba-325e-4e6a-bbf6-d258bb149be5 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:13.468796 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9abba-325e-4e6a-bbf6-d258bb149be5 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:13.469215 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9abba-325e-4e6a-bbf6-d258bb149be5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:13.476451 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d9abba-325e-4e6a-bbf6-d258bb149be5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:13.480009 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d9abba-325e-4e6a-bbf6-d258bb149be5 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:13.503836 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-63d9abba-325e-4e6a-bbf6-d258bb149be5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 04:06:13.503836 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:13.503836 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:13.503836 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:13.503836 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:13.503836 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:13.503836 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:13.503836 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:13.503836 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:13.503836 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:13.503836 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:13.503836 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:13.503836 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 04:06:13.503836 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 04:06:13.503836 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 04:06:13.504800 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 04:06:13.504800 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:13.504800 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:13.504800 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:13.504800 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:13.504800 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:13.504800 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:13.504800 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:13.504800 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:13.504800 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:13.504800 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:13.504800 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:13.504800 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:13.504800 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:13.504800 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:13.504800 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:13.504800 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:13.505954 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 04:06:13.505954 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 04:06:13.505954 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 04:06:13.505954 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 04:06:13.505954 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 04:06:13.505954 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 04:06:13.505954 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 04:06:13.505954 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:13.505954 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 414/857] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Jun 18 04:06:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:13.510621 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d9abba-325e-4e6a-bbf6-d258bb149be5 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:13.535278 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e6819-6d79-49a4-bfc1-ad443396225c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:13.581574 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e0cd1-634f-4348-a2ea-3e1b25c74a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:13.582336 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e0cd1-634f-4348-a2ea-3e1b25c74a52 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:13.582682 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e0cd1-634f-4348-a2ea-3e1b25c74a52 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:13.583014 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e0cd1-634f-4348-a2ea-3e1b25c74a52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:13.648702 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d9abba-325e-4e6a-bbf6-d258bb149be5 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:13.659202 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e0cd1-634f-4348-a2ea-3e1b25c74a52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:13.660944 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e0cd1-634f-4348-a2ea-3e1b25c74a52 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:13.685688 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9089fb-7cc6-4af4-baf5-2f7ba2eca5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:13.686442 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9089fb-7cc6-4af4-baf5-2f7ba2eca5d9 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:13.686789 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9089fb-7cc6-4af4-baf5-2f7ba2eca5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:13.687128 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9089fb-7cc6-4af4-baf5-2f7ba2eca5d9 None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:13.687873 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:13.688958 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9089fb-7cc6-4af4-baf5-2f7ba2eca5d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:13.689346 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9089fb-7cc6-4af4-baf5-2f7ba2eca5d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:13.691155 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9089fb-7cc6-4af4-baf5-2f7ba2eca5d9 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:13.699970 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:13.707533 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 415/858] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Jun 18 04:06:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:06:13.717683 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9089fb-7cc6-4af4-baf5-2f7ba2eca5d9 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:13.781942 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 444/859] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Jun 18 04:06:13 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 18 04:06:13.789592 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e0cd1-634f-4348-a2ea-3e1b25c74a52 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:13.830459 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9089fb-7cc6-4af4-baf5-2f7ba2eca5d9 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:13.868413 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c34e73-181b-4926-b67d-dc49434f6cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:13.869151 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c34e73-181b-4926-b67d-dc49434f6cd6 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:13.869427 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c34e73-181b-4926-b67d-dc49434f6cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:13.869695 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c34e73-181b-4926-b67d-dc49434f6cd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:13.871193 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c34e73-181b-4926-b67d-dc49434f6cd6 None admin] RBAC: Adding query filter params (role.id=f055a7ed241c4492a4f92494099bab54, scope.project.id=9649aee8c5554102bc4193003300a3ad, user.id=310a7b366bee40f38960d76e56b52986) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:13.871508 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c34e73-181b-4926-b67d-dc49434f6cd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:13.872991 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c34e73-181b-4926-b67d-dc49434f6cd6 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:13.888738 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 416/860] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Jun 18 04:06:13 2022] GET /identity/v3/role_assignments?user.id=310a7b366bee40f38960d76e56b52986&scope.project.id=9649aee8c5554102bc4193003300a3ad&role.id=f055a7ed241c4492a4f92494099bab54 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:13.913638 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e0cd1-634f-4348-a2ea-3e1b25c74a52 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:13.941756 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:13.955165 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed996c79-64a1-45a6-95cf-60ec3d867da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:13.956478 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed996c79-64a1-45a6-95cf-60ec3d867da9 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:13.956990 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed996c79-64a1-45a6-95cf-60ec3d867da9 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:13.957463 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed996c79-64a1-45a6-95cf-60ec3d867da9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:13.969357 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed996c79-64a1-45a6-95cf-60ec3d867da9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:13.971223 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed996c79-64a1-45a6-95cf-60ec3d867da9 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:13.992182 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-ed996c79-64a1-45a6-95cf-60ec3d867da9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:06:13.992182 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:13.992182 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:13.992182 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:13.992182 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:13.992182 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:13.992182 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:13.992182 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:13.992182 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:13.992182 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:13.992182 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:13.992182 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:13.992182 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:06:13.992182 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:06:13.992182 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:06:13.993232 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:06:13.993232 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:13.993232 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:13.993232 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:13.993232 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:13.993232 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:13.993232 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:13.993232 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:13.993232 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:13.993232 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:13.993232 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:13.993232 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:13.993232 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:13.993232 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:13.993232 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:13.993232 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:13.993232 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:13.994216 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:06:13.994216 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:06:13.994216 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:06:13.994216 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:13.996562 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 445/861] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:06:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:14.002676 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c34e73-181b-4926-b67d-dc49434f6cd6 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:14.069257 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:14.098559 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f4d9f-1f34-437c-8071-4404c7cc12dd None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:14.098979 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f4d9f-1f34-437c-8071-4404c7cc12dd None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:14.099356 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f4d9f-1f34-437c-8071-4404c7cc12dd None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:14.101028 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 446/862] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:06:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 18 04:06:14.110023 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf3acb-27ba-4960-b877-be75a70e3579 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:14.110310 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf3acb-27ba-4960-b877-be75a70e3579 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:14.110590 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf3acb-27ba-4960-b877-be75a70e3579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:14.116336 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c34e73-181b-4926-b67d-dc49434f6cd6 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:14.129497 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-93bf3acb-27ba-4960-b877-be75a70e3579 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:06:14.130763 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-93bf3acb-27ba-4960-b877-be75a70e3579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:06:14.159569 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26488210-cdd4-44fe-99de-f9ff07e0f494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:14.160001 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26488210-cdd4-44fe-99de-f9ff07e0f494 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:14.160268 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26488210-cdd4-44fe-99de-f9ff07e0f494 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:14.160549 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26488210-cdd4-44fe-99de-f9ff07e0f494 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:14.161307 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26488210-cdd4-44fe-99de-f9ff07e0f494 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:14.161612 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26488210-cdd4-44fe-99de-f9ff07e0f494 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:14.163002 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26488210-cdd4-44fe-99de-f9ff07e0f494 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:14.180659 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 417/863] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:06:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:14.185761 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26488210-cdd4-44fe-99de-f9ff07e0f494 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:14.219464 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 447/864] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:06:14 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 18 04:06:14.238131 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf3acb-27ba-4960-b877-be75a70e3579 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:14.316032 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26488210-cdd4-44fe-99de-f9ff07e0f494 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:14.345926 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf3acb-27ba-4960-b877-be75a70e3579 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:14.347891 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:14.349808 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:14.368744 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9cad88-fe69-42ea-9865-02aaec489fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:14.369983 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9cad88-fe69-42ea-9865-02aaec489fef None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:14.370496 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9cad88-fe69-42ea-9865-02aaec489fef None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:14.370959 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9cad88-fe69-42ea-9865-02aaec489fef None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:14.381532 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9cad88-fe69-42ea-9865-02aaec489fef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:14.383663 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9cad88-fe69-42ea-9865-02aaec489fef None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:14.385962 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06008172-3ed3-4dd9-949e-27757026e471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:14.386924 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06008172-3ed3-4dd9-949e-27757026e471 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:14.387172 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06008172-3ed3-4dd9-949e-27757026e471 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:14.387434 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06008172-3ed3-4dd9-949e-27757026e471 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:14.388149 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06008172-3ed3-4dd9-949e-27757026e471 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:14.389603 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06008172-3ed3-4dd9-949e-27757026e471 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:14.400238 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-aa9cad88-fe69-42ea-9865-02aaec489fef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 04:06:14.400238 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:14.400238 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:14.400238 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:14.400238 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:14.400238 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:14.400238 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:14.400238 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:14.400238 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:14.400238 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:14.400238 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:14.400238 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:14.400238 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 04:06:14.400238 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 04:06:14.400238 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 04:06:14.401173 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 04:06:14.401173 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:14.401173 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:14.401173 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:14.401173 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:14.401173 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:14.401173 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:14.401173 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:14.401173 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:14.401173 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:14.401173 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:14.401173 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:14.401173 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:14.401173 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:14.401173 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:14.401173 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:14.401173 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:14.402095 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 04:06:14.402095 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 04:06:14.402095 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 04:06:14.402095 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 04:06:14.402095 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 04:06:14.402095 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 04:06:14.402095 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 04:06:14.402095 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:14.402532 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-06008172-3ed3-4dd9-949e-27757026e471 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 18 04:06:14.402532 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:14.402532 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 18 04:06:14.402532 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 18 04:06:14.402532 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 18 04:06:14.402532 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 18 04:06:14.402532 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 18 04:06:14.402532 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 04:06:14.402532 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 18 04:06:14.402532 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:14.402532 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 04:06:14.402532 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:14.402532 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:14.402532 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:14.402532 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:14.402532 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:14.403386 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:14.403386 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:14.403386 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:14.403386 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:14.403386 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:14.403386 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:14.403386 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:14.403386 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 18 04:06:14.403386 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 18 04:06:14.403386 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 18 04:06:14.403386 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 18 04:06:14.403386 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:14.403386 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:14.403386 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:14.403386 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:14.403386 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:14.404211 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:14.404211 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:14.404211 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:14.404211 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:14.404211 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:14.404211 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:14.404211 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:14.404211 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:14.404211 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:14.404211 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:14.404211 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:14.404211 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 18 04:06:14.404211 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 04:06:14.404211 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 18 04:06:14.404211 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:14.407454 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 418/866] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Jun 18 04:06:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 04:06:14.408780 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 448/866] 10.222.0.20 () {56 vars in 1132 bytes} [Sat Jun 18 04:06:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 04:06:14.409808 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9cad88-fe69-42ea-9865-02aaec489fef None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:14.412842 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06008172-3ed3-4dd9-949e-27757026e471 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:14.524533 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06008172-3ed3-4dd9-949e-27757026e471 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:14.538738 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9cad88-fe69-42ea-9865-02aaec489fef None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:14.569913 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e222f-a55e-4dca-b431-fd3b8cb4982b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:14.570696 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e222f-a55e-4dca-b431-fd3b8cb4982b None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:14.571107 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e222f-a55e-4dca-b431-fd3b8cb4982b None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:14.571658 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e222f-a55e-4dca-b431-fd3b8cb4982b None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:14.572944 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e222f-a55e-4dca-b431-fd3b8cb4982b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:14.573342 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e222f-a55e-4dca-b431-fd3b8cb4982b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:14.575238 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e222f-a55e-4dca-b431-fd3b8cb4982b None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:14.578261 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa897f-a378-4b33-b835-94f117c9b533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:14.579161 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa897f-a378-4b33-b835-94f117c9b533 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:14.579612 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa897f-a378-4b33-b835-94f117c9b533 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:14.580055 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa897f-a378-4b33-b835-94f117c9b533 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:14.580985 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa897f-a378-4b33-b835-94f117c9b533 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:14.581468 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa897f-a378-4b33-b835-94f117c9b533 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:14.583039 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa897f-a378-4b33-b835-94f117c9b533 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:14.588782 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 419/867] 10.222.0.20 () {56 vars in 1126 bytes} [Sat Jun 18 04:06:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:14.593882 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa897f-a378-4b33-b835-94f117c9b533 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:14.594002 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 449/868] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Jun 18 04:06:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:14.599493 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e222f-a55e-4dca-b431-fd3b8cb4982b None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:14.648599 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:14.659028 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:14.703585 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa897f-a378-4b33-b835-94f117c9b533 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:14.722814 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e222f-a55e-4dca-b431-fd3b8cb4982b None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:14.738335 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a69d3e-60b8-4471-b600-8b70667d3678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:14.738996 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a69d3e-60b8-4471-b600-8b70667d3678 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:14.739279 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a69d3e-60b8-4471-b600-8b70667d3678 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:14.739541 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a69d3e-60b8-4471-b600-8b70667d3678 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:14.740248 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a69d3e-60b8-4471-b600-8b70667d3678 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:14.740548 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a69d3e-60b8-4471-b600-8b70667d3678 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:14.741937 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a69d3e-60b8-4471-b600-8b70667d3678 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:14.753213 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 420/869] 10.222.0.20 () {56 vars in 1126 bytes} [Sat Jun 18 04:06:14 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:06:14.753213 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9507b906-85f2-4bb7-8b8a-70748a97ec0c None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:14.753213 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9507b906-85f2-4bb7-8b8a-70748a97ec0c None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:14.753213 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9507b906-85f2-4bb7-8b8a-70748a97ec0c None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:14.753213 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 421/870] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:06:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:06:14.755347 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcda64-895d-4100-b4da-624ee61c4f51 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:14.755656 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcda64-895d-4100-b4da-624ee61c4f51 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:14.755752 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcda64-895d-4100-b4da-624ee61c4f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:14.773437 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86acfc1-ee34-417b-860c-97e005172233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:14.774372 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86acfc1-ee34-417b-860c-97e005172233 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:14.774877 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86acfc1-ee34-417b-860c-97e005172233 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:14.775184 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86acfc1-ee34-417b-860c-97e005172233 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:14.775511 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-c9dcda64-895d-4100-b4da-624ee61c4f51 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:06:14.776243 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86acfc1-ee34-417b-860c-97e005172233 None admin] RBAC: Adding query filter params (role.id=d783a633c75847d48ef7ef5b169b0313, scope.project.id=9649aee8c5554102bc4193003300a3ad, user.id=fbfd82b05777466b97d46d376d4e11eb) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:14.776677 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86acfc1-ee34-417b-860c-97e005172233 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:14.776795 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-c9dcda64-895d-4100-b4da-624ee61c4f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:06:14.778326 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86acfc1-ee34-417b-860c-97e005172233 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:14.800355 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 450/871] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Jun 18 04:06:14 2022] GET /identity/v3/role_assignments?user.id=fbfd82b05777466b97d46d376d4e11eb&scope.project.id=9649aee8c5554102bc4193003300a3ad&role.id=d783a633c75847d48ef7ef5b169b0313 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:06:14.861578 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 422/872] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:06:14 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 04:06:14.885443 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86acfc1-ee34-417b-860c-97e005172233 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:14.986592 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:14.996735 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86acfc1-ee34-417b-860c-97e005172233 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:15.031797 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d59794-c3c0-4fa0-9441-bcea76220353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:15.032510 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d59794-c3c0-4fa0-9441-bcea76220353 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:15.032903 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d59794-c3c0-4fa0-9441-bcea76220353 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:15.033267 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d59794-c3c0-4fa0-9441-bcea76220353 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:15.034089 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d59794-c3c0-4fa0-9441-bcea76220353 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:15.035540 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d59794-c3c0-4fa0-9441-bcea76220353 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:15.053102 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 451/873] 10.222.0.20 () {60 vars in 1141 bytes} [Sat Jun 18 04:06:14 2022] POST /identity/v3/services => generated 251 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 04:06:16.131817 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a3530-f486-4263-9e58-aef789eb4777 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:16.132330 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a3530-f486-4263-9e58-aef789eb4777 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:16.132330 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a3530-f486-4263-9e58-aef789eb4777 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:16.134048 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 423/874] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:06:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:06:16.139399 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a5f54d-be16-4538-8186-7ecc356a6bbe None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:16.139873 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a5f54d-be16-4538-8186-7ecc356a6bbe None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:16.139953 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a5f54d-be16-4538-8186-7ecc356a6bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:16.157199 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-c2a5f54d-be16-4538-8186-7ecc356a6bbe None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:06:16.158394 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-c2a5f54d-be16-4538-8186-7ecc356a6bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:06:16.238849 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 452/875] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:06:16 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 04:06:16.262063 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a3530-f486-4263-9e58-aef789eb4777 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:16.305928 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:16.366675 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a3530-f486-4263-9e58-aef789eb4777 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:16.400822 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96decab6-2987-41fc-870f-8b5e2d24d9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:16.401686 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96decab6-2987-41fc-870f-8b5e2d24d9e8 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:16.401962 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96decab6-2987-41fc-870f-8b5e2d24d9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:16.402232 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96decab6-2987-41fc-870f-8b5e2d24d9e8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:16.412853 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96decab6-2987-41fc-870f-8b5e2d24d9e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:06:16.421160 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-96decab6-2987-41fc-870f-8b5e2d24d9e8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 18 04:06:16.421160 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:16.421160 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:16.421160 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:16.421160 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:16.421160 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:16.421160 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:16.421160 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:16.421160 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:16.421160 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:16.421160 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:16.421160 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:16.421160 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:06:16.421160 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:06:16.421160 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:06:16.421160 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:06:16.422072 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:06:16.422072 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:06:16.422072 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:06:16.422072 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:06:16.422072 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:16.422072 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:16.422072 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:16.422072 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:16.422072 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:16.422072 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:16.422072 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:16.422072 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:16.422072 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:16.422072 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:16.422072 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:16.422072 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:16.423283 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:16.423283 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:16.423283 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:16.423283 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:16.423283 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:06:16.423283 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:06:16.423283 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:06:16.423283 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:06:16.423283 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:06:16.423283 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:06:16.423283 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 18 04:06:16.423283 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:16.423283 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 424/876] 10.222.0.20 () {56 vars in 1120 bytes} [Sat Jun 18 04:06:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:16.428535 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a5f54d-be16-4538-8186-7ecc356a6bbe None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:16.511963 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:16.534882 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a5f54d-be16-4538-8186-7ecc356a6bbe None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:16.570057 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d14a5d9-20d2-4ea1-947b-a247365cadcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:16.570729 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d14a5d9-20d2-4ea1-947b-a247365cadcc None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:16.571039 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d14a5d9-20d2-4ea1-947b-a247365cadcc None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:16.571309 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d14a5d9-20d2-4ea1-947b-a247365cadcc None admin] PATH_INFO: `/v3/roles` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:16.572052 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d14a5d9-20d2-4ea1-947b-a247365cadcc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:16.572350 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d14a5d9-20d2-4ea1-947b-a247365cadcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:16.573792 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d14a5d9-20d2-4ea1-947b-a247365cadcc None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:16.582495 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 453/877] 10.222.0.20 () {56 vars in 1115 bytes} [Sat Jun 18 04:06:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:16.587887 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96decab6-2987-41fc-870f-8b5e2d24d9e8 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:16.696772 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:16.699809 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96decab6-2987-41fc-870f-8b5e2d24d9e8 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:16.741156 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff38c4b-29a0-4736-a4cd-9787f230f1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:16.741962 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff38c4b-29a0-4736-a4cd-9787f230f1cf None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:16.742238 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff38c4b-29a0-4736-a4cd-9787f230f1cf None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:16.742507 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff38c4b-29a0-4736-a4cd-9787f230f1cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:16.754000 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff38c4b-29a0-4736-a4cd-9787f230f1cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:16.755321 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff38c4b-29a0-4736-a4cd-9787f230f1cf None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:16.773233 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-3ff38c4b-29a0-4736-a4cd-9787f230f1cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:06:16.773233 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:16.773233 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:16.773233 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:16.773233 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:16.773233 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:16.773233 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:16.773233 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:16.773233 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:16.773233 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:16.773233 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:16.773233 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:16.773233 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:06:16.773233 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:06:16.773233 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:06:16.774214 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:06:16.774214 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:16.774214 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:16.774214 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:16.774214 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:16.774214 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:16.774214 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:16.774214 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:16.774214 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:16.774214 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:16.774214 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:16.774214 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:16.774214 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:16.774214 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:16.774214 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:16.774214 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:16.774214 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:16.775657 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:06:16.775657 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:06:16.775657 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:06:16.775657 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:16.775657 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 425/878] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:06:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:16.780117 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d14a5d9-20d2-4ea1-947b-a247365cadcc None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:16.885096 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf283ee-cfcf-418f-8a28-fa882464145d None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:16.885405 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf283ee-cfcf-418f-8a28-fa882464145d None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:16.885869 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf283ee-cfcf-418f-8a28-fa882464145d None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:16.887659 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 426/879] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:06:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 18 04:06:16.889526 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d14a5d9-20d2-4ea1-947b-a247365cadcc None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:16.893019 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee18eac-06c9-499a-9ef1-6cb4509bec6e None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:16.893302 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee18eac-06c9-499a-9ef1-6cb4509bec6e None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:16.893574 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee18eac-06c9-499a-9ef1-6cb4509bec6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:16.911395 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-aee18eac-06c9-499a-9ef1-6cb4509bec6e None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:06:16.912704 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-aee18eac-06c9-499a-9ef1-6cb4509bec6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:06:16.924227 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02df1db-7cf9-4743-be95-1daa104697a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:16.924927 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02df1db-7cf9-4743-be95-1daa104697a1 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:16.925204 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02df1db-7cf9-4743-be95-1daa104697a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:16.925475 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02df1db-7cf9-4743-be95-1daa104697a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:16.926191 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02df1db-7cf9-4743-be95-1daa104697a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:16.926495 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02df1db-7cf9-4743-be95-1daa104697a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:16.927945 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02df1db-7cf9-4743-be95-1daa104697a1 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:16.937306 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:16.940912 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 454/880] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:06:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:16.942397 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c8905-ce66-4dbd-bf9e-bfa62555c224 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:16.942989 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c8905-ce66-4dbd-bf9e-bfa62555c224 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:16.943256 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c8905-ce66-4dbd-bf9e-bfa62555c224 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:16.945631 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 455/881] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:06:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:06:16.945800 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12c8905-ce66-4dbd-bf9e-bfa62555c224 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:16.997025 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 427/882] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:06:16 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 18 04:06:16.997025 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58ebe7-46c3-400f-8794-44f1ff37ac05 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:16.997025 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58ebe7-46c3-400f-8794-44f1ff37ac05 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:16.997025 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58ebe7-46c3-400f-8794-44f1ff37ac05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:17.022656 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-ce58ebe7-46c3-400f-8794-44f1ff37ac05 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:06:17.023898 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-ce58ebe7-46c3-400f-8794-44f1ff37ac05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:06:17.066428 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12c8905-ce66-4dbd-bf9e-bfa62555c224 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:17.104170 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 428/883] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:06:16 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 04:06:17.105352 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb28ca9-fc0b-4394-9b5d-9afd00bc9fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:17.105613 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce58ebe7-46c3-400f-8794-44f1ff37ac05 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:17.106187 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb28ca9-fc0b-4394-9b5d-9afd00bc9fed None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:17.106457 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb28ca9-fc0b-4394-9b5d-9afd00bc9fed None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:17.106706 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb28ca9-fc0b-4394-9b5d-9afd00bc9fed None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:17.120486 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb28ca9-fc0b-4394-9b5d-9afd00bc9fed None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:17.121860 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:17.123622 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb28ca9-fc0b-4394-9b5d-9afd00bc9fed None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:17.142882 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-adb28ca9-fc0b-4394-9b5d-9afd00bc9fed None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 18 04:06:17.142882 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:17.142882 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:17.142882 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:17.142882 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:17.142882 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:17.142882 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:17.142882 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:17.142882 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:17.142882 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:17.142882 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:17.142882 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:17.142882 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 04:06:17.142882 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 04:06:17.142882 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 04:06:17.142882 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 04:06:17.144309 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:17.144309 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:17.144309 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 04:06:17.144309 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 04:06:17.144309 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 04:06:17.144309 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 04:06:17.144309 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:17.144309 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:17.144309 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:17.144309 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:17.144309 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:17.144309 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:17.144309 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:17.144309 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:17.144309 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:17.144309 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:17.144309 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:17.144309 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:17.145284 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:17.145284 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:17.145284 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 04:06:17.145284 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 04:06:17.145284 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 04:06:17.145284 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 04:06:17.145284 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 04:06:17.145284 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 04:06:17.145284 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 18 04:06:17.145284 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:17.145284 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 456/884] 10.222.0.20 () {56 vars in 1117 bytes} [Sat Jun 18 04:06:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:17.145284 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb28ca9-fc0b-4394-9b5d-9afd00bc9fed None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:17.204390 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:17.207882 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce58ebe7-46c3-400f-8794-44f1ff37ac05 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:17.240996 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6b15f7-a5a8-46ba-be81-697385f00672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:17.241656 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b15f7-a5a8-46ba-be81-697385f00672 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:17.241934 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b15f7-a5a8-46ba-be81-697385f00672 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:17.242206 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b15f7-a5a8-46ba-be81-697385f00672 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:17.242980 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6b15f7-a5a8-46ba-be81-697385f00672 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:17.243989 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb28ca9-fc0b-4394-9b5d-9afd00bc9fed None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:17.244350 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6b15f7-a5a8-46ba-be81-697385f00672 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:17.259263 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 429/885] 10.222.0.20 () {60 vars in 1141 bytes} [Sat Jun 18 04:06:17 2022] POST /identity/v3/services => generated 269 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 04:06:17.260598 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51142e20-127a-4450-a6fb-056fea03a8d0 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:17.260882 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51142e20-127a-4450-a6fb-056fea03a8d0 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:17.261184 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51142e20-127a-4450-a6fb-056fea03a8d0 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:17.264742 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 430/886] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:06:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:06:17.266058 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51142e20-127a-4450-a6fb-056fea03a8d0 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:17.289122 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d0700-3fd3-4fbf-abf7-8b18655f908f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:17.289869 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d0700-3fd3-4fbf-abf7-8b18655f908f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:17.290143 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d0700-3fd3-4fbf-abf7-8b18655f908f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:17.290404 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d0700-3fd3-4fbf-abf7-8b18655f908f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:17.291060 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51d0700-3fd3-4fbf-abf7-8b18655f908f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:17.292610 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51d0700-3fd3-4fbf-abf7-8b18655f908f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:17.306165 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-c51d0700-3fd3-4fbf-abf7-8b18655f908f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 18 04:06:17.306165 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:17.306165 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 18 04:06:17.306165 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 18 04:06:17.306165 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 18 04:06:17.306165 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 18 04:06:17.306165 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 18 04:06:17.306165 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 04:06:17.306165 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 18 04:06:17.306165 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:17.306165 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 04:06:17.306165 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:17.306165 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:17.306165 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:17.306165 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:17.306165 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:17.306165 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:17.307367 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:17.307367 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:17.307367 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:17.307367 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:17.307367 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:17.307367 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:17.307367 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 18 04:06:17.307367 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 18 04:06:17.307367 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 18 04:06:17.307367 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 18 04:06:17.307367 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:17.307367 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:17.307367 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:17.307367 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:17.307367 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:17.307367 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:17.308209 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:17.308209 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:17.308209 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:17.308209 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:17.308209 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:17.308209 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:17.308209 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:17.308209 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:17.308209 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:17.308209 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:17.308209 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 18 04:06:17.308209 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 04:06:17.308209 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 18 04:06:17.308209 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:17.308209 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 457/887] 10.222.0.20 () {56 vars in 1126 bytes} [Sat Jun 18 04:06:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:17.309028 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6e65c-7353-417c-8eba-e4834a4542af None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:17.309113 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6e65c-7353-417c-8eba-e4834a4542af None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:17.309855 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6e65c-7353-417c-8eba-e4834a4542af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:17.328329 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-2eb6e65c-7353-417c-8eba-e4834a4542af None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:06:17.329584 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2eb6e65c-7353-417c-8eba-e4834a4542af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:06:17.360176 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:17.394266 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51142e20-127a-4450-a6fb-056fea03a8d0 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:17.412630 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 458/888] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:06:17 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 04:06:17.412630 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6e65c-7353-417c-8eba-e4834a4542af None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:17.443775 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f658caea-e532-4a6a-93be-15adf5178190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:17.444741 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658caea-e532-4a6a-93be-15adf5178190 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:17.445188 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658caea-e532-4a6a-93be-15adf5178190 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:17.445614 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658caea-e532-4a6a-93be-15adf5178190 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:17.446619 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f658caea-e532-4a6a-93be-15adf5178190 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:17.446930 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f658caea-e532-4a6a-93be-15adf5178190 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:17.448507 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f658caea-e532-4a6a-93be-15adf5178190 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:17.467216 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 431/889] 10.222.0.20 () {56 vars in 1149 bytes} [Sat Jun 18 04:06:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:17.467745 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:17.469493 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f658caea-e532-4a6a-93be-15adf5178190 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:17.521843 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6e65c-7353-417c-8eba-e4834a4542af None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:17.557702 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8e6ed-309a-419c-9106-ee969dd11bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:17.558281 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8e6ed-309a-419c-9106-ee969dd11bd8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:17.558563 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8e6ed-309a-419c-9106-ee969dd11bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:17.558834 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8e6ed-309a-419c-9106-ee969dd11bd8 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:17.559540 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b8e6ed-309a-419c-9106-ee969dd11bd8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:17.559840 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b8e6ed-309a-419c-9106-ee969dd11bd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:17.561352 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b8e6ed-309a-419c-9106-ee969dd11bd8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:17.570671 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 459/890] 10.222.0.20 () {56 vars in 1122 bytes} [Sat Jun 18 04:06:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:17.570671 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8e6ed-309a-419c-9106-ee969dd11bd8 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:17.579257 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f658caea-e532-4a6a-93be-15adf5178190 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:17.612957 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:17.620908 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d36b4-5f73-44c5-8b75-90490669307e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:17.621721 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d36b4-5f73-44c5-8b75-90490669307e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:17.621996 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d36b4-5f73-44c5-8b75-90490669307e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:17.622267 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d36b4-5f73-44c5-8b75-90490669307e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:17.622923 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243d36b4-5f73-44c5-8b75-90490669307e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:17.624302 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243d36b4-5f73-44c5-8b75-90490669307e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:17.636309 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-243d36b4-5f73-44c5-8b75-90490669307e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 18 04:06:17.636309 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:17.636309 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 18 04:06:17.636309 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 18 04:06:17.636309 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 18 04:06:17.636309 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 18 04:06:17.636309 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 18 04:06:17.636309 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 04:06:17.636309 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 18 04:06:17.636309 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:17.636309 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 04:06:17.636309 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:17.636309 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:17.636309 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:17.636309 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:17.636309 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:17.636309 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:17.637329 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:17.637329 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:17.637329 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:17.637329 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:17.637329 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:17.637329 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:17.637329 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 18 04:06:17.637329 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 18 04:06:17.637329 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 18 04:06:17.637329 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 18 04:06:17.637329 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:17.637329 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:17.637329 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:17.637329 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:17.637329 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:17.637329 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:17.638171 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:17.638171 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:17.638171 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:17.638171 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:17.638171 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:17.638171 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:17.638171 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:17.638171 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:17.638171 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:17.638171 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:17.638171 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 18 04:06:17.638171 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 04:06:17.638171 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 18 04:06:17.638171 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:17.638171 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 432/891] 10.222.0.20 () {56 vars in 1114 bytes} [Sat Jun 18 04:06:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:17.638980 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d36b4-5f73-44c5-8b75-90490669307e None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:17.684101 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8e6ed-309a-419c-9106-ee969dd11bd8 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:17.700070 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:17.725020 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196bc827-35f3-4906-82ae-63150e124fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:17.725832 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196bc827-35f3-4906-82ae-63150e124fcb None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:17.726109 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196bc827-35f3-4906-82ae-63150e124fcb None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:17.726665 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196bc827-35f3-4906-82ae-63150e124fcb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:17.741315 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d36b4-5f73-44c5-8b75-90490669307e None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:17.778570 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46739cfd-f16a-4baa-b4df-a70cf11e1617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:17.779238 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46739cfd-f16a-4baa-b4df-a70cf11e1617 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:17.779514 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46739cfd-f16a-4baa-b4df-a70cf11e1617 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:17.779782 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46739cfd-f16a-4baa-b4df-a70cf11e1617 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:17.780488 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46739cfd-f16a-4baa-b4df-a70cf11e1617 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:17.780823 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46739cfd-f16a-4baa-b4df-a70cf11e1617 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:17.782190 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46739cfd-f16a-4baa-b4df-a70cf11e1617 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:17.788611 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 433/892] 10.222.0.20 () {56 vars in 1122 bytes} [Sat Jun 18 04:06:17 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:17.788611 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46739cfd-f16a-4baa-b4df-a70cf11e1617 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:17.820154 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196bc827-35f3-4906-82ae-63150e124fcb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:17.821928 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196bc827-35f3-4906-82ae-63150e124fcb None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:17.877649 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:17.929640 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46739cfd-f16a-4baa-b4df-a70cf11e1617 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:17.956125 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 460/893] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Jun 18 04:06:17 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 18 04:06:17.964106 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196bc827-35f3-4906-82ae-63150e124fcb None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:17.981338 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea276f-1b01-49fc-895e-f2c7522b57fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:17.982335 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:17.984252 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea276f-1b01-49fc-895e-f2c7522b57fa None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:17.984968 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea276f-1b01-49fc-895e-f2c7522b57fa None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:17.985517 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea276f-1b01-49fc-895e-f2c7522b57fa None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:17.986242 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cea276f-1b01-49fc-895e-f2c7522b57fa None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:17.986773 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cea276f-1b01-49fc-895e-f2c7522b57fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:17.989193 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cea276f-1b01-49fc-895e-f2c7522b57fa None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:17.995467 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 434/894] 10.222.0.20 () {56 vars in 1114 bytes} [Sat Jun 18 04:06:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:18.001081 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea276f-1b01-49fc-895e-f2c7522b57fa None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:18.099845 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196bc827-35f3-4906-82ae-63150e124fcb None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:18.103387 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea276f-1b01-49fc-895e-f2c7522b57fa None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:18.135330 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:18.139090 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f1f0c6-a9f1-4255-a9a4-e1f4be65c076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:18.140135 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1f0c6-a9f1-4255-a9a4-e1f4be65c076 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:18.140869 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1f0c6-a9f1-4255-a9a4-e1f4be65c076 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:18.141463 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1f0c6-a9f1-4255-a9a4-e1f4be65c076 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:18.142392 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f1f0c6-a9f1-4255-a9a4-e1f4be65c076 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:18.142970 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f1f0c6-a9f1-4255-a9a4-e1f4be65c076 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:18.143257 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429cdf4b-47ff-4414-9601-355d642177b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:18.144059 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429cdf4b-47ff-4414-9601-355d642177b1 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:18.144338 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429cdf4b-47ff-4414-9601-355d642177b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:18.144630 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429cdf4b-47ff-4414-9601-355d642177b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:18.146061 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f1f0c6-a9f1-4255-a9a4-e1f4be65c076 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:18.151773 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 435/895] 10.222.0.20 () {56 vars in 1114 bytes} [Sat Jun 18 04:06:18 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:06:18.160967 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429cdf4b-47ff-4414-9601-355d642177b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:18.161563 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f1f0c6-a9f1-4255-a9a4-e1f4be65c076 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:18.162434 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429cdf4b-47ff-4414-9601-355d642177b1 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:18.181433 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-429cdf4b-47ff-4414-9601-355d642177b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:06:18.181433 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:18.181433 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:18.181433 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:18.181433 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:18.181433 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:18.181433 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:18.181433 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:18.181433 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:18.181433 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:18.181433 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:18.181433 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:18.181433 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:06:18.181433 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:06:18.181433 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:06:18.182374 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:06:18.182374 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:18.182374 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:18.182374 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:18.182374 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:18.182374 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:18.182374 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:18.182374 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:18.182374 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:18.182374 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:18.182374 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:18.182374 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:18.182374 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:18.182374 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:18.182374 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:18.182374 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:18.182374 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:18.183283 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:06:18.183283 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:06:18.183283 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:06:18.183283 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:18.187483 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 461/896] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:06:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:18.188539 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429cdf4b-47ff-4414-9601-355d642177b1 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:18.264626 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:18.280450 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f1f0c6-a9f1-4255-a9a4-e1f4be65c076 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:18.309253 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429cdf4b-47ff-4414-9601-355d642177b1 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:18.315196 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2244f559-f98d-46fb-bfd0-29dfb486f346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:18.315923 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244f559-f98d-46fb-bfd0-29dfb486f346 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:18.316257 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244f559-f98d-46fb-bfd0-29dfb486f346 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:18.316532 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244f559-f98d-46fb-bfd0-29dfb486f346 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:18.317383 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2244f559-f98d-46fb-bfd0-29dfb486f346 None admin] RBAC: Adding query filter params (interface=public, service_id=0c1d0277596e4c369a91c0bf172bf1b4, region_id=RegionOne) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:18.317695 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2244f559-f98d-46fb-bfd0-29dfb486f346 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:18.319179 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2244f559-f98d-46fb-bfd0-29dfb486f346 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:18.331636 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 436/897] 10.222.0.20 () {56 vars in 1251 bytes} [Sat Jun 18 04:06:18 2022] GET /identity/v3/endpoints?service_id=0c1d0277596e4c369a91c0bf172bf1b4&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:18.332531 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2244f559-f98d-46fb-bfd0-29dfb486f346 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:18.348529 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6da637-af39-4286-a2c5-0c191d4844e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:18.349264 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6da637-af39-4286-a2c5-0c191d4844e7 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:18.349624 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6da637-af39-4286-a2c5-0c191d4844e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:18.349817 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6da637-af39-4286-a2c5-0c191d4844e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:18.350608 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6da637-af39-4286-a2c5-0c191d4844e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:18.350854 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6da637-af39-4286-a2c5-0c191d4844e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:18.352408 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6da637-af39-4286-a2c5-0c191d4844e7 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:18.370197 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 462/898] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:06:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:06:18.380630 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6da637-af39-4286-a2c5-0c191d4844e7 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:18.408506 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:18.465329 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2244f559-f98d-46fb-bfd0-29dfb486f346 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:18.500851 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb64de85-0b7f-41b1-971d-64de48a38aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:18.501527 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64de85-0b7f-41b1-971d-64de48a38aa5 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:18.501795 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64de85-0b7f-41b1-971d-64de48a38aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:18.502152 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64de85-0b7f-41b1-971d-64de48a38aa5 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:18.502756 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb64de85-0b7f-41b1-971d-64de48a38aa5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:18.504135 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb64de85-0b7f-41b1-971d-64de48a38aa5 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:18.517009 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 437/899] 10.222.0.20 () {56 vars in 1087 bytes} [Sat Jun 18 04:06:18 2022] GET /identity/v3/services => generated 1268 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 04:06:18.521144 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6da637-af39-4286-a2c5-0c191d4844e7 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:18.552255 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:18.563610 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428829a3-a41f-419d-9020-e5495b6c26d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:18.564942 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428829a3-a41f-419d-9020-e5495b6c26d0 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:18.565426 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428829a3-a41f-419d-9020-e5495b6c26d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:18.565943 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428829a3-a41f-419d-9020-e5495b6c26d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:18.574571 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428829a3-a41f-419d-9020-e5495b6c26d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:18.576406 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428829a3-a41f-419d-9020-e5495b6c26d0 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:18.592626 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-428829a3-a41f-419d-9020-e5495b6c26d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 04:06:18.592626 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:18.592626 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:18.592626 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:18.592626 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:18.592626 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:18.592626 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:18.592626 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:18.592626 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:18.592626 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:18.592626 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:18.592626 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:18.592626 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 04:06:18.592626 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 04:06:18.592626 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 04:06:18.593569 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 04:06:18.593569 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:18.593569 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:18.593569 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:18.593569 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:18.593569 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:18.593569 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:18.593569 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:18.593569 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:18.593569 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:18.593569 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:18.593569 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:18.593569 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:18.593569 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:18.593569 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:18.593569 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:18.593569 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:18.594447 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 04:06:18.594447 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 04:06:18.594447 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 04:06:18.594447 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 04:06:18.594447 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 04:06:18.594447 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 04:06:18.594447 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 04:06:18.594447 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:18.597229 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 463/900] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Jun 18 04:06:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 04:06:18.605659 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb64de85-0b7f-41b1-971d-64de48a38aa5 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:18.718583 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb64de85-0b7f-41b1-971d-64de48a38aa5 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:18.738839 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:18.769339 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b9f4c7-c12b-492c-adac-19040e730b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:18.770349 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b9f4c7-c12b-492c-adac-19040e730b7d None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:18.770818 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b9f4c7-c12b-492c-adac-19040e730b7d None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:18.771268 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b9f4c7-c12b-492c-adac-19040e730b7d None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:18.772238 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b9f4c7-c12b-492c-adac-19040e730b7d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:18.772745 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b9f4c7-c12b-492c-adac-19040e730b7d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:18.774486 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b9f4c7-c12b-492c-adac-19040e730b7d None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:18.787923 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 438/901] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Jun 18 04:06:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:18.794298 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428829a3-a41f-419d-9020-e5495b6c26d0 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:18.897131 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428829a3-a41f-419d-9020-e5495b6c26d0 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:18.934168 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfed883-64f6-4ebb-a181-9bf15d4f5f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:18.935190 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfed883-64f6-4ebb-a181-9bf15d4f5f9f None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:18.935647 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfed883-64f6-4ebb-a181-9bf15d4f5f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:18.936092 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfed883-64f6-4ebb-a181-9bf15d4f5f9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:18.937152 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfed883-64f6-4ebb-a181-9bf15d4f5f9f None admin] RBAC: Adding query filter params (role.id=d4273747919d492bb44d9c0f6ee20e91, scope.project.id=9649aee8c5554102bc4193003300a3ad, user.id=310a7b366bee40f38960d76e56b52986) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:18.937643 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfed883-64f6-4ebb-a181-9bf15d4f5f9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:18.939319 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfed883-64f6-4ebb-a181-9bf15d4f5f9f None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:18.946093 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 464/902] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Jun 18 04:06:18 2022] GET /identity/v3/role_assignments?user.id=310a7b366bee40f38960d76e56b52986&scope.project.id=9649aee8c5554102bc4193003300a3ad&role.id=d4273747919d492bb44d9c0f6ee20e91 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:19.363942 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6d30c-e757-4b28-a51e-5c53dbb9635b None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:19.364473 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6d30c-e757-4b28-a51e-5c53dbb9635b None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:19.364473 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6d30c-e757-4b28-a51e-5c53dbb9635b None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:19.366428 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 439/903] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:06:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:06:19.371953 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83d5e4-2a18-4974-b740-562d760e1507 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:19.372386 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83d5e4-2a18-4974-b740-562d760e1507 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:19.372722 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83d5e4-2a18-4974-b740-562d760e1507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:19.389818 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-8b83d5e4-2a18-4974-b740-562d760e1507 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:06:19.391002 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8b83d5e4-2a18-4974-b740-562d760e1507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:06:19.440846 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:19.462430 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 465/904] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:06:19 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 04:06:19.485140 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6d30c-e757-4b28-a51e-5c53dbb9635b None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:19.592350 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6d30c-e757-4b28-a51e-5c53dbb9635b None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:19.628045 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9561fc3-a37b-44f7-a2c7-f72078fba663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:19.629119 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9561fc3-a37b-44f7-a2c7-f72078fba663 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:19.629535 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9561fc3-a37b-44f7-a2c7-f72078fba663 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:19.629942 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9561fc3-a37b-44f7-a2c7-f72078fba663 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:19.630736 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9561fc3-a37b-44f7-a2c7-f72078fba663 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:19.632266 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9561fc3-a37b-44f7-a2c7-f72078fba663 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:19.645123 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-f9561fc3-a37b-44f7-a2c7-f72078fba663 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 18 04:06:19.645123 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:19.645123 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 18 04:06:19.645123 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 18 04:06:19.645123 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 18 04:06:19.645123 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 18 04:06:19.645123 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 18 04:06:19.645123 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 04:06:19.645123 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 18 04:06:19.645123 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:19.645123 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 04:06:19.645123 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:19.645123 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:19.645123 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:19.645123 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:19.645123 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:19.646288 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:19.646288 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:19.646288 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:19.646288 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:19.646288 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:19.646288 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:19.646288 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:19.646288 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 18 04:06:19.646288 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 18 04:06:19.646288 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 18 04:06:19.646288 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 18 04:06:19.646288 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:19.646288 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:19.646288 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:19.646288 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:19.646288 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:19.647326 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:19.647326 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:19.647326 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:19.647326 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:19.647326 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:19.647326 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:19.647326 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:19.647326 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:19.647326 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:19.647326 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:19.647326 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:19.647326 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 18 04:06:19.647326 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 04:06:19.647326 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 18 04:06:19.647326 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:19.650033 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 440/905] 10.222.0.20 () {56 vars in 1132 bytes} [Sat Jun 18 04:06:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:19.657614 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83d5e4-2a18-4974-b740-562d760e1507 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:19.763088 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83d5e4-2a18-4974-b740-562d760e1507 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:19.798738 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f69ad1-f505-4539-a88d-2fe698d80b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:19.799454 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f69ad1-f505-4539-a88d-2fe698d80b47 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:19.799731 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f69ad1-f505-4539-a88d-2fe698d80b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:19.799996 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f69ad1-f505-4539-a88d-2fe698d80b47 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:19.800740 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f69ad1-f505-4539-a88d-2fe698d80b47 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:19.801041 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f69ad1-f505-4539-a88d-2fe698d80b47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:19.802407 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f69ad1-f505-4539-a88d-2fe698d80b47 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:19.808732 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 466/906] 10.222.0.20 () {56 vars in 1126 bytes} [Sat Jun 18 04:06:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:19.814390 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9561fc3-a37b-44f7-a2c7-f72078fba663 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:19.859893 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:19.869155 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1bc949-0d24-4a19-b6c8-9f6ffafd73d9 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:19.869431 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1bc949-0d24-4a19-b6c8-9f6ffafd73d9 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:19.869703 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1bc949-0d24-4a19-b6c8-9f6ffafd73d9 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:19.871331 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 467/907] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:06:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:06:19.877047 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091b7e4-914d-4b22-9b72-6a76cc91a6ff None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:19.877380 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091b7e4-914d-4b22-9b72-6a76cc91a6ff None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:19.877654 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091b7e4-914d-4b22-9b72-6a76cc91a6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:19.898541 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-2091b7e4-914d-4b22-9b72-6a76cc91a6ff None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:06:19.900097 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-2091b7e4-914d-4b22-9b72-6a76cc91a6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:06:19.928150 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9561fc3-a37b-44f7-a2c7-f72078fba663 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:19.948866 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:19.970777 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4757d146-0f0e-4125-8caa-1444bcd1e536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:19.971777 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757d146-0f0e-4125-8caa-1444bcd1e536 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:19.972318 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757d146-0f0e-4125-8caa-1444bcd1e536 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:19.972816 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757d146-0f0e-4125-8caa-1444bcd1e536 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:19.973726 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4757d146-0f0e-4125-8caa-1444bcd1e536 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:19.974229 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4757d146-0f0e-4125-8caa-1444bcd1e536 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:19.975830 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4757d146-0f0e-4125-8caa-1444bcd1e536 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:19.981653 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 441/908] 10.222.0.20 () {56 vars in 1126 bytes} [Sat Jun 18 04:06:19 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:19.988010 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4757d146-0f0e-4125-8caa-1444bcd1e536 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:19.996643 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 468/909] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:06:19 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 18 04:06:20.014083 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091b7e4-914d-4b22-9b72-6a76cc91a6ff None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:20.095974 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4757d146-0f0e-4125-8caa-1444bcd1e536 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:20.116434 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091b7e4-914d-4b22-9b72-6a76cc91a6ff None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:20.120981 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:20.133306 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3557c1-c1eb-48d6-8d31-2d74e4d3f008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:20.134078 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3557c1-c1eb-48d6-8d31-2d74e4d3f008 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:20.134358 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3557c1-c1eb-48d6-8d31-2d74e4d3f008 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:20.134678 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3557c1-c1eb-48d6-8d31-2d74e4d3f008 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:20.135645 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3557c1-c1eb-48d6-8d31-2d74e4d3f008 None admin] RBAC: Adding query filter params (interface=public, service_id=fb1a650b98304dd0befb7673b8a968ca, region_id=RegionOne) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:20.135960 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3557c1-c1eb-48d6-8d31-2d74e4d3f008 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:20.137688 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3557c1-c1eb-48d6-8d31-2d74e4d3f008 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:20.150025 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 442/910] 10.222.0.20 () {56 vars in 1251 bytes} [Sat Jun 18 04:06:19 2022] GET /identity/v3/endpoints?service_id=fb1a650b98304dd0befb7673b8a968ca&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:06:20.151254 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3557c1-c1eb-48d6-8d31-2d74e4d3f008 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:20.161449 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b6da38-acf0-4233-8de3-07ca2538f5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:20.162411 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6da38-acf0-4233-8de3-07ca2538f5e5 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:20.163226 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6da38-acf0-4233-8de3-07ca2538f5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:20.163704 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6da38-acf0-4233-8de3-07ca2538f5e5 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:20.165028 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b6da38-acf0-4233-8de3-07ca2538f5e5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:20.166881 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b6da38-acf0-4233-8de3-07ca2538f5e5 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:20.186491 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 469/911] 10.222.0.20 () {60 vars in 1141 bytes} [Sat Jun 18 04:06:20 2022] POST /identity/v3/services => generated 241 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 04:06:20.267066 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3557c1-c1eb-48d6-8d31-2d74e4d3f008 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:20.311557 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7190c-b072-48f0-811e-643ed12f1272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:20.312631 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7190c-b072-48f0-811e-643ed12f1272 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:20.313088 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7190c-b072-48f0-811e-643ed12f1272 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:20.313532 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7190c-b072-48f0-811e-643ed12f1272 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:20.314460 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb7190c-b072-48f0-811e-643ed12f1272 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:20.316045 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb7190c-b072-48f0-811e-643ed12f1272 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:20.323565 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 443/912] 10.222.0.20 () {56 vars in 1087 bytes} [Sat Jun 18 04:06:20 2022] GET /identity/v3/services => generated 1497 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 04:06:20.734604 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59759695-bb90-4d00-ab65-066b78f0c1a6 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:20.735136 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59759695-bb90-4d00-ab65-066b78f0c1a6 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:20.735136 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59759695-bb90-4d00-ab65-066b78f0c1a6 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:20.736763 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 470/913] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:06:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:06:20.742915 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44220e-b614-4c9c-8a4b-d9c00e591949 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:20.743345 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44220e-b614-4c9c-8a4b-d9c00e591949 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:20.743487 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44220e-b614-4c9c-8a4b-d9c00e591949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:20.762000 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-cc44220e-b614-4c9c-8a4b-d9c00e591949 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:06:20.763409 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-cc44220e-b614-4c9c-8a4b-d9c00e591949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:06:20.791728 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:20.844683 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 444/914] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:06:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 04:06:20.862262 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59759695-bb90-4d00-ab65-066b78f0c1a6 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:20.897368 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:20.973168 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59759695-bb90-4d00-ab65-066b78f0c1a6 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:21.009261 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6c065-bdb9-4a7c-baf3-d1c6d9420620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:21.009994 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6c065-bdb9-4a7c-baf3-d1c6d9420620 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:21.010274 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6c065-bdb9-4a7c-baf3-d1c6d9420620 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:21.010547 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6c065-bdb9-4a7c-baf3-d1c6d9420620 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:21.011207 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe6c065-bdb9-4a7c-baf3-d1c6d9420620 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:21.012606 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe6c065-bdb9-4a7c-baf3-d1c6d9420620 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:21.018016 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124093c-f357-4016-9c6d-0ed220be9c99 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:21.018304 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124093c-f357-4016-9c6d-0ed220be9c99 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:21.018580 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124093c-f357-4016-9c6d-0ed220be9c99 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:21.020227 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 445/915] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:06:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:06:21.025032 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce1152-f11b-46e6-9266-64a06b014500 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:21.025480 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-6fe6c065-bdb9-4a7c-baf3-d1c6d9420620 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 18 04:06:21.025480 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:21.025480 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 18 04:06:21.025480 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 18 04:06:21.025480 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 18 04:06:21.025480 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 18 04:06:21.025480 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 18 04:06:21.025480 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 04:06:21.025480 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 18 04:06:21.025480 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:21.025480 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 04:06:21.025480 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:21.025480 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:21.025480 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:21.025480 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:21.025480 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:21.025480 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:21.026420 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:21.026420 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:21.026420 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:21.026420 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:21.026420 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:21.026420 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:21.026420 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 18 04:06:21.026420 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 18 04:06:21.026420 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 18 04:06:21.026420 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 18 04:06:21.026420 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:21.026420 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:21.026420 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:21.026420 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:21.026420 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:21.026420 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:21.027253 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:21.027253 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:21.027253 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:21.027253 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:21.027253 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:21.027253 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:21.027253 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:21.027253 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:21.027253 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:21.027253 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:21.027253 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 18 04:06:21.027253 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 04:06:21.027253 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 18 04:06:21.027253 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:21.027253 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 471/916] 10.222.0.20 () {56 vars in 1114 bytes} [Sat Jun 18 04:06:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:21.028773 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce1152-f11b-46e6-9266-64a06b014500 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:21.029256 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce1152-f11b-46e6-9266-64a06b014500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:21.032486 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6c065-bdb9-4a7c-baf3-d1c6d9420620 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:21.046985 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-62ce1152-f11b-46e6-9266-64a06b014500 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:06:21.048658 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-62ce1152-f11b-46e6-9266-64a06b014500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:06:21.126253 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 446/917] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:06:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 04:06:21.146108 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:21.149155 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce1152-f11b-46e6-9266-64a06b014500 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:21.150813 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6c065-bdb9-4a7c-baf3-d1c6d9420620 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:21.187176 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8550ce4f-7c82-4f96-8319-43bdc76ccba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:21.188239 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550ce4f-7c82-4f96-8319-43bdc76ccba9 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:21.188776 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550ce4f-7c82-4f96-8319-43bdc76ccba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:21.189250 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550ce4f-7c82-4f96-8319-43bdc76ccba9 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:21.190252 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8550ce4f-7c82-4f96-8319-43bdc76ccba9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:21.190888 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8550ce4f-7c82-4f96-8319-43bdc76ccba9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:21.192472 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8550ce4f-7c82-4f96-8319-43bdc76ccba9 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:21.198100 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 472/918] 10.222.0.20 () {56 vars in 1114 bytes} [Sat Jun 18 04:06:21 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:21.203435 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8550ce4f-7c82-4f96-8319-43bdc76ccba9 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:21.257340 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:21.276853 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce1152-f11b-46e6-9266-64a06b014500 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:21.314438 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8550ce4f-7c82-4f96-8319-43bdc76ccba9 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:21.320247 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfae6dfb-92b0-482d-9d51-410a57ff4d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:21.321154 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae6dfb-92b0-482d-9d51-410a57ff4d5f None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:21.321437 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae6dfb-92b0-482d-9d51-410a57ff4d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:21.321794 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae6dfb-92b0-482d-9d51-410a57ff4d5f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:21.335413 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfae6dfb-92b0-482d-9d51-410a57ff4d5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:06:21.346350 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-dfae6dfb-92b0-482d-9d51-410a57ff4d5f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 18 04:06:21.346350 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:21.346350 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:21.346350 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:21.346350 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:21.346350 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:21.346350 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:21.346350 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:21.346350 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:21.346350 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:21.346350 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:21.346350 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:21.346350 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:06:21.346350 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:06:21.346350 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:06:21.346350 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:06:21.347280 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:06:21.347280 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:06:21.347280 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:06:21.347280 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:06:21.347280 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:21.347280 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:21.347280 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:21.347280 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:21.347280 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:21.347280 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:21.347280 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:21.347280 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:21.347280 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:21.347280 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:21.347280 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:21.347280 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:21.348149 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:21.348149 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:21.348149 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:21.348149 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:21.348149 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:06:21.348149 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:06:21.348149 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:06:21.348149 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:06:21.348149 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:06:21.348149 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:06:21.348149 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 18 04:06:21.348149 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:21.352874 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 447/919] 10.222.0.20 () {56 vars in 1120 bytes} [Sat Jun 18 04:06:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 04:06:21.354343 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfae6dfb-92b0-482d-9d51-410a57ff4d5f None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:21.359993 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53edc778-1ad5-40c1-92c1-5c34f511d7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:21.361068 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53edc778-1ad5-40c1-92c1-5c34f511d7bb None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:21.361550 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53edc778-1ad5-40c1-92c1-5c34f511d7bb None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:21.362033 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53edc778-1ad5-40c1-92c1-5c34f511d7bb None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:21.363059 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53edc778-1ad5-40c1-92c1-5c34f511d7bb None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:21.363583 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53edc778-1ad5-40c1-92c1-5c34f511d7bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:21.365364 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53edc778-1ad5-40c1-92c1-5c34f511d7bb None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:21.372174 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 473/920] 10.222.0.20 () {56 vars in 1114 bytes} [Sat Jun 18 04:06:21 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:21.380624 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53edc778-1ad5-40c1-92c1-5c34f511d7bb None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:21.406354 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:21.489523 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53edc778-1ad5-40c1-92c1-5c34f511d7bb None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:21.490709 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfae6dfb-92b0-482d-9d51-410a57ff4d5f None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:21.525951 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ddb970-d8e4-4708-9c38-8b5eeb0be32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:21.526647 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ddb970-d8e4-4708-9c38-8b5eeb0be32a None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:21.526990 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ddb970-d8e4-4708-9c38-8b5eeb0be32a None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:21.527203 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ddb970-d8e4-4708-9c38-8b5eeb0be32a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:21.527971 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ddb970-d8e4-4708-9c38-8b5eeb0be32a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:21.529413 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ddb970-d8e4-4708-9c38-8b5eeb0be32a None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:21.538972 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5b186-f175-4442-b22d-ea83ce531db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:21.539785 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5b186-f175-4442-b22d-ea83ce531db3 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:21.540135 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5b186-f175-4442-b22d-ea83ce531db3 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:21.540468 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5b186-f175-4442-b22d-ea83ce531db3 None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:21.541366 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b5b186-f175-4442-b22d-ea83ce531db3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:21.541702 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b5b186-f175-4442-b22d-ea83ce531db3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:21.543069 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b5b186-f175-4442-b22d-ea83ce531db3 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:21.556456 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 474/922] 10.222.0.20 () {60 vars in 1144 bytes} [Sat Jun 18 04:06:21 2022] POST /identity/v3/endpoints => generated 346 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 04:06:21.556739 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 448/922] 10.222.0.20 () {56 vars in 1115 bytes} [Sat Jun 18 04:06:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:21.557680 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5b186-f175-4442-b22d-ea83ce531db3 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:21.570514 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:21.673398 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5b186-f175-4442-b22d-ea83ce531db3 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:21.720556 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5330bcd7-fe0d-48a8-85d8-a547cf5b9e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:21.721927 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330bcd7-fe0d-48a8-85d8-a547cf5b9e4d None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:21.722421 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330bcd7-fe0d-48a8-85d8-a547cf5b9e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:21.722893 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330bcd7-fe0d-48a8-85d8-a547cf5b9e4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:21.735504 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5330bcd7-fe0d-48a8-85d8-a547cf5b9e4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:21.737434 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5330bcd7-fe0d-48a8-85d8-a547cf5b9e4d None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:21.756479 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-5330bcd7-fe0d-48a8-85d8-a547cf5b9e4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:06:21.756479 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:21.756479 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:21.756479 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:21.756479 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:21.756479 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:21.756479 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:21.756479 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:21.756479 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:21.756479 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:21.756479 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:21.756479 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:21.756479 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:06:21.756479 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:06:21.756479 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:06:21.757934 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:06:21.757934 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:21.757934 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:21.757934 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:21.757934 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:21.757934 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:21.757934 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:21.757934 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:21.757934 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:21.757934 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:21.757934 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:21.757934 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:21.757934 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:21.757934 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:21.757934 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:21.757934 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:21.757934 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:21.759084 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:06:21.759084 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:06:21.759084 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:06:21.759084 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:21.759852 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 449/923] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:06:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:21.765542 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ddb970-d8e4-4708-9c38-8b5eeb0be32a None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:21.855267 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:21.873875 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ddb970-d8e4-4708-9c38-8b5eeb0be32a None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:21.908804 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb0307-c3d0-4116-96a0-138d7000785c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:21.909478 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb0307-c3d0-4116-96a0-138d7000785c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:21.909756 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb0307-c3d0-4116-96a0-138d7000785c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:21.910025 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb0307-c3d0-4116-96a0-138d7000785c None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:21.910755 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfb0307-c3d0-4116-96a0-138d7000785c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:21.911056 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfb0307-c3d0-4116-96a0-138d7000785c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:21.912432 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfb0307-c3d0-4116-96a0-138d7000785c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:21.925390 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 475/924] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:06:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:21.933740 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5330bcd7-fe0d-48a8-85d8-a547cf5b9e4d None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:22.000189 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:22.045379 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5330bcd7-fe0d-48a8-85d8-a547cf5b9e4d None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:22.079370 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844207dd-5616-43b0-8f0b-83ce7deb5d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:22.080192 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844207dd-5616-43b0-8f0b-83ce7deb5d97 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:22.080468 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844207dd-5616-43b0-8f0b-83ce7deb5d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:22.080764 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844207dd-5616-43b0-8f0b-83ce7deb5d97 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:22.090030 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844207dd-5616-43b0-8f0b-83ce7deb5d97 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:22.091540 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844207dd-5616-43b0-8f0b-83ce7deb5d97 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:22.108387 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-844207dd-5616-43b0-8f0b-83ce7deb5d97 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 18 04:06:22.108387 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:22.108387 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:22.108387 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:22.108387 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:22.108387 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:22.108387 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:22.108387 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:22.108387 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:22.108387 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:22.108387 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:22.108387 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:22.108387 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 04:06:22.108387 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 04:06:22.108387 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 04:06:22.108387 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 04:06:22.109805 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:22.109805 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:22.109805 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 04:06:22.109805 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 04:06:22.109805 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 04:06:22.109805 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 04:06:22.109805 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:22.109805 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:22.109805 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:22.109805 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:22.109805 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:22.109805 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:22.109805 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:22.109805 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:22.109805 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:22.109805 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:22.109805 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:22.109805 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:22.111434 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:22.111434 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:22.111434 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 04:06:22.111434 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 04:06:22.111434 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 04:06:22.111434 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 04:06:22.111434 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 04:06:22.111434 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 04:06:22.111434 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 18 04:06:22.111434 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:22.111434 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 450/925] 10.222.0.20 () {56 vars in 1117 bytes} [Sat Jun 18 04:06:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 04:06:22.115960 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb0307-c3d0-4116-96a0-138d7000785c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:22.218057 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb0307-c3d0-4116-96a0-138d7000785c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:22.252834 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e99329-c2a0-4f09-b051-cd38bcf4750c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:22.253493 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e99329-c2a0-4f09-b051-cd38bcf4750c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:22.253772 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e99329-c2a0-4f09-b051-cd38bcf4750c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:22.254042 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e99329-c2a0-4f09-b051-cd38bcf4750c None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:22.254880 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e99329-c2a0-4f09-b051-cd38bcf4750c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:22.255182 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e99329-c2a0-4f09-b051-cd38bcf4750c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:22.256638 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e99329-c2a0-4f09-b051-cd38bcf4750c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:22.274562 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 476/926] 10.222.0.20 () {56 vars in 1149 bytes} [Sat Jun 18 04:06:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:22.275152 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:22.279913 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844207dd-5616-43b0-8f0b-83ce7deb5d97 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:22.333634 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8788e-13b0-401c-8f29-da7bb1b8d1eb None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:22.333986 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8788e-13b0-401c-8f29-da7bb1b8d1eb None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:22.334181 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8788e-13b0-401c-8f29-da7bb1b8d1eb None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:22.336304 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 477/927] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:06:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 18 04:06:22.341697 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49981a4-372d-4002-8b34-fb9c4cecc006 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:22.341988 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49981a4-372d-4002-8b34-fb9c4cecc006 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:22.342260 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49981a4-372d-4002-8b34-fb9c4cecc006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:22.363776 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-e49981a4-372d-4002-8b34-fb9c4cecc006 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:06:22.365239 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-e49981a4-372d-4002-8b34-fb9c4cecc006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:06:22.387175 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844207dd-5616-43b0-8f0b-83ce7deb5d97 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:22.403653 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:22.427404 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8510dea1-c419-40e7-9173-29fded2b3480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:22.428304 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510dea1-c419-40e7-9173-29fded2b3480 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:22.428738 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510dea1-c419-40e7-9173-29fded2b3480 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:22.429019 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510dea1-c419-40e7-9173-29fded2b3480 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:22.440418 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8510dea1-c419-40e7-9173-29fded2b3480 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:22.441917 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8510dea1-c419-40e7-9173-29fded2b3480 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:22.450181 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 478/928] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:06:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 04:06:22.464531 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260c251-03f4-4b49-8ced-747086216f37 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:22.464531 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260c251-03f4-4b49-8ced-747086216f37 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:22.464531 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260c251-03f4-4b49-8ced-747086216f37 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:22.464531 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 479/929] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:06:22 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:06:22.464901 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-8510dea1-c419-40e7-9173-29fded2b3480 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:06:22.464901 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:22.464901 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:22.464901 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:22.464901 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:22.464901 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:22.464901 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:22.464901 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:22.464901 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:22.464901 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:22.464901 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:22.464901 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:22.464901 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:06:22.464901 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:06:22.464901 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:06:22.465691 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:06:22.465691 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:22.465691 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:22.465691 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:22.465691 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:22.465691 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:22.465691 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:22.465691 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:22.465691 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:22.465691 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:22.465691 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:22.465691 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:22.465691 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:22.465691 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:22.465691 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:22.465691 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:22.465691 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:22.466566 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:06:22.466566 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:06:22.466566 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:06:22.466566 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:22.466566 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 451/930] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:06:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:22.467358 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ccdb2-f8d1-4985-bb03-52f9e25af86f None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:22.467639 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ccdb2-f8d1-4985-bb03-52f9e25af86f None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:22.467912 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ccdb2-f8d1-4985-bb03-52f9e25af86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:22.468679 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8510dea1-c419-40e7-9173-29fded2b3480 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:22.486204 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-260ccdb2-f8d1-4985-bb03-52f9e25af86f None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:06:22.487515 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-260ccdb2-f8d1-4985-bb03-52f9e25af86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:06:22.557502 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 480/931] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:06:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 04:06:22.558159 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ccdb2-f8d1-4985-bb03-52f9e25af86f None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:22.582476 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8510dea1-c419-40e7-9173-29fded2b3480 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:22.618553 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8133c7-1e6d-4e87-939e-a2df6d7ad605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:22.619150 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8133c7-1e6d-4e87-939e-a2df6d7ad605 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:22.619435 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8133c7-1e6d-4e87-939e-a2df6d7ad605 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:22.619703 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8133c7-1e6d-4e87-939e-a2df6d7ad605 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:22.620437 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8133c7-1e6d-4e87-939e-a2df6d7ad605 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:22.621034 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8133c7-1e6d-4e87-939e-a2df6d7ad605 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:22.622189 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8133c7-1e6d-4e87-939e-a2df6d7ad605 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:22.624613 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:22.638643 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 452/932] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:22.638643 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8133c7-1e6d-4e87-939e-a2df6d7ad605 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:22.667175 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:22.674026 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ccdb2-f8d1-4985-bb03-52f9e25af86f None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:22.713746 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12800859-ddc3-42f9-973b-c3f92ca348de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:22.714801 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12800859-ddc3-42f9-973b-c3f92ca348de None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:22.715255 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12800859-ddc3-42f9-973b-c3f92ca348de None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:22.715664 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12800859-ddc3-42f9-973b-c3f92ca348de None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:22.716456 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12800859-ddc3-42f9-973b-c3f92ca348de None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:22.718176 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12800859-ddc3-42f9-973b-c3f92ca348de None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:22.731185 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-12800859-ddc3-42f9-973b-c3f92ca348de None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 18 04:06:22.731185 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:22.731185 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 18 04:06:22.731185 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 18 04:06:22.731185 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 18 04:06:22.731185 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 18 04:06:22.731185 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 18 04:06:22.731185 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 04:06:22.731185 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 18 04:06:22.731185 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:22.731185 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 04:06:22.731185 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:22.731185 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:22.731185 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:22.731185 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:22.731185 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:22.731185 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:22.732424 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:22.732424 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:22.732424 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:22.732424 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:22.732424 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:22.732424 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:22.732424 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 18 04:06:22.732424 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 18 04:06:22.732424 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 18 04:06:22.732424 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 18 04:06:22.732424 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:22.732424 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:22.732424 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:22.732424 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:22.732424 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:22.732424 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:22.733505 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:22.733505 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:22.733505 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:22.733505 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:22.733505 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:22.733505 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:22.733505 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:22.733505 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:22.733505 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:22.733505 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:22.733505 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 18 04:06:22.733505 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 04:06:22.733505 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 18 04:06:22.733505 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:22.736387 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 481/933] 10.222.0.20 () {56 vars in 1126 bytes} [Sat Jun 18 04:06:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:22.737341 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12800859-ddc3-42f9-973b-c3f92ca348de None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:22.748634 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8133c7-1e6d-4e87-939e-a2df6d7ad605 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:22.788537 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b25a1d-a24d-4281-ad4b-b0acecafe8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:22.789412 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b25a1d-a24d-4281-ad4b-b0acecafe8f9 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:22.789770 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b25a1d-a24d-4281-ad4b-b0acecafe8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:22.790041 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b25a1d-a24d-4281-ad4b-b0acecafe8f9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:22.790734 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b25a1d-a24d-4281-ad4b-b0acecafe8f9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:22.792184 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b25a1d-a24d-4281-ad4b-b0acecafe8f9 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:22.805408 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-c7b25a1d-a24d-4281-ad4b-b0acecafe8f9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 18 04:06:22.805408 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:22.805408 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 18 04:06:22.805408 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 18 04:06:22.805408 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 18 04:06:22.805408 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 18 04:06:22.805408 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 18 04:06:22.805408 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 04:06:22.805408 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 18 04:06:22.805408 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:22.805408 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 04:06:22.805408 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:22.805408 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:22.805408 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:22.805408 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:22.805408 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:22.806446 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:22.806446 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:22.806446 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:22.806446 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:22.806446 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:22.806446 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:22.806446 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:22.806446 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 18 04:06:22.806446 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 18 04:06:22.806446 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 18 04:06:22.806446 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 18 04:06:22.806446 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:22.806446 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:22.806446 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:22.806446 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:22.806446 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:22.807262 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:22.807262 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:22.807262 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:22.807262 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:22.807262 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:22.807262 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:22.807262 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:22.807262 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:22.807262 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:22.807262 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:22.807262 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:22.807262 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 18 04:06:22.807262 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 04:06:22.807262 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 18 04:06:22.807262 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:22.807262 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 453/934] 10.222.0.20 () {56 vars in 1132 bytes} [Sat Jun 18 04:06:22 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:22.808136 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b25a1d-a24d-4281-ad4b-b0acecafe8f9 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:22.852929 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12800859-ddc3-42f9-973b-c3f92ca348de None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:22.877573 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:22.889206 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b26aadc-d6c0-4bef-9ea3-e2f7bd03a032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:22.890009 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26aadc-d6c0-4bef-9ea3-e2f7bd03a032 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:22.890285 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26aadc-d6c0-4bef-9ea3-e2f7bd03a032 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:22.890551 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26aadc-d6c0-4bef-9ea3-e2f7bd03a032 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:22.899793 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b26aadc-d6c0-4bef-9ea3-e2f7bd03a032 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:22.901240 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b26aadc-d6c0-4bef-9ea3-e2f7bd03a032 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:22.911496 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:22.917407 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-6b26aadc-d6c0-4bef-9ea3-e2f7bd03a032 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 04:06:22.917407 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:22.917407 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:22.917407 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:22.917407 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:22.917407 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:22.917407 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:22.917407 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:22.917407 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:22.917407 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:22.917407 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:22.917407 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:22.917407 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 04:06:22.917407 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 04:06:22.917407 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 04:06:22.918298 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 04:06:22.918298 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:22.918298 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:22.918298 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:22.918298 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:22.918298 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:22.918298 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:22.918298 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:22.918298 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:22.918298 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:22.918298 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:22.918298 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:22.918298 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:22.918298 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:22.918298 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:22.918298 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:22.918298 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:22.919177 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 04:06:22.919177 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 04:06:22.919177 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 04:06:22.919177 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 04:06:22.919177 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 04:06:22.919177 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 04:06:22.919177 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 04:06:22.919177 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:22.919177 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 482/935] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Jun 18 04:06:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:22.919697 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b26aadc-d6c0-4bef-9ea3-e2f7bd03a032 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:22.922735 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b25a1d-a24d-4281-ad4b-b0acecafe8f9 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:22.970857 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce452db-428f-4836-b00c-0226cb0c20dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:22.971615 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce452db-428f-4836-b00c-0226cb0c20dd None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:22.971997 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce452db-428f-4836-b00c-0226cb0c20dd None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:22.972308 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce452db-428f-4836-b00c-0226cb0c20dd None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:22.973060 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce452db-428f-4836-b00c-0226cb0c20dd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:22.973446 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce452db-428f-4836-b00c-0226cb0c20dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:22.974947 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce452db-428f-4836-b00c-0226cb0c20dd None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:22.984787 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 454/936] 10.222.0.20 () {56 vars in 1122 bytes} [Sat Jun 18 04:06:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:22.984787 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce452db-428f-4836-b00c-0226cb0c20dd None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:23.033745 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b26aadc-d6c0-4bef-9ea3-e2f7bd03a032 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:23.070348 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad62fc-69b9-4f14-9250-7740143c92d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:23.071162 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad62fc-69b9-4f14-9250-7740143c92d8 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:23.071423 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad62fc-69b9-4f14-9250-7740143c92d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:23.071689 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad62fc-69b9-4f14-9250-7740143c92d8 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:23.072497 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaad62fc-69b9-4f14-9250-7740143c92d8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:23.072838 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaad62fc-69b9-4f14-9250-7740143c92d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:23.074312 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaad62fc-69b9-4f14-9250-7740143c92d8 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:23.083859 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 483/937] 10.222.0.20 () {56 vars in 1126 bytes} [Sat Jun 18 04:06:22 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:23.083859 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad62fc-69b9-4f14-9250-7740143c92d8 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:23.084100 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce452db-428f-4836-b00c-0226cb0c20dd None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:23.120873 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa9e9d5-6b60-4ecd-aff9-18c4283a3d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:23.121537 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9e9d5-6b60-4ecd-aff9-18c4283a3d3f None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:23.121819 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9e9d5-6b60-4ecd-aff9-18c4283a3d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:23.122093 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9e9d5-6b60-4ecd-aff9-18c4283a3d3f None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:23.122876 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa9e9d5-6b60-4ecd-aff9-18c4283a3d3f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:23.123183 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa9e9d5-6b60-4ecd-aff9-18c4283a3d3f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:23.124644 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa9e9d5-6b60-4ecd-aff9-18c4283a3d3f None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:23.137225 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:23.137789 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 455/938] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Jun 18 04:06:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:23.138620 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa9e9d5-6b60-4ecd-aff9-18c4283a3d3f None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:23.160552 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:23.194371 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad62fc-69b9-4f14-9250-7740143c92d8 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:23.230567 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139835d3-ef36-444d-a848-9fcad423c2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:23.231233 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139835d3-ef36-444d-a848-9fcad423c2c1 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:23.231510 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139835d3-ef36-444d-a848-9fcad423c2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:23.231779 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139835d3-ef36-444d-a848-9fcad423c2c1 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:23.232486 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139835d3-ef36-444d-a848-9fcad423c2c1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:23.232808 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139835d3-ef36-444d-a848-9fcad423c2c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:23.234537 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139835d3-ef36-444d-a848-9fcad423c2c1 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:23.244381 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 484/939] 10.222.0.20 () {56 vars in 1122 bytes} [Sat Jun 18 04:06:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:23.244381 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139835d3-ef36-444d-a848-9fcad423c2c1 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:23.251122 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa9e9d5-6b60-4ecd-aff9-18c4283a3d3f None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:23.287592 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecedf25-a241-43b8-9694-67d52ea3209a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:23.288257 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecedf25-a241-43b8-9694-67d52ea3209a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:23.288539 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecedf25-a241-43b8-9694-67d52ea3209a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:23.288840 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecedf25-a241-43b8-9694-67d52ea3209a None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:23.289585 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecedf25-a241-43b8-9694-67d52ea3209a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:23.289899 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecedf25-a241-43b8-9694-67d52ea3209a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:23.291276 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecedf25-a241-43b8-9694-67d52ea3209a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:23.296173 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 456/940] 10.222.0.20 () {56 vars in 1126 bytes} [Sat Jun 18 04:06:23 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:23.296993 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecedf25-a241-43b8-9694-67d52ea3209a None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:23.354980 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139835d3-ef36-444d-a848-9fcad423c2c1 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:23.368928 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:23.384940 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:23.393899 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c5b85a-da08-489b-bd82-a49c6093cece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:23.394732 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5b85a-da08-489b-bd82-a49c6093cece None admin] REQUEST_METHOD: `PUT` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:23.395009 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5b85a-da08-489b-bd82-a49c6093cece None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:23.395280 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5b85a-da08-489b-bd82-a49c6093cece None admin] PATH_INFO: `/v3/projects/9649aee8c5554102bc4193003300a3ad/users/310a7b366bee40f38960d76e56b52986/roles/d4273747919d492bb44d9c0f6ee20e91` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:23.397561 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c5b85a-da08-489b-bd82-a49c6093cece None admin] RBAC: Authorizing `identity:create_grant(project_id=9649aee8c5554102bc4193003300a3ad, user_id=310a7b366bee40f38960d76e56b52986, role_id=d4273747919d492bb44d9c0f6ee20e91)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:23.399072 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c5b85a-da08-489b-bd82-a49c6093cece None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:23.405599 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecedf25-a241-43b8-9694-67d52ea3209a None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:23.415819 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 485/941] 10.222.0.20 () {58 vars in 1439 bytes} [Sat Jun 18 04:06:23 2022] PUT /identity/v3/projects/9649aee8c5554102bc4193003300a3ad/users/310a7b366bee40f38960d76e56b52986/roles/d4273747919d492bb44d9c0f6ee20e91 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 04:06:23.417230 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c5b85a-da08-489b-bd82-a49c6093cece None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:23.444030 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9a1e60-13d9-4f21-aed6-d334eeeb2a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:23.445289 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a1e60-13d9-4f21-aed6-d334eeeb2a9a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:23.445611 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a1e60-13d9-4f21-aed6-d334eeeb2a9a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:23.446075 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a1e60-13d9-4f21-aed6-d334eeeb2a9a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:23.446947 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9a1e60-13d9-4f21-aed6-d334eeeb2a9a None admin] RBAC: Adding query filter params (interface=public, service_id=daef65ff6f1c45eba353652b0abecc9e, region_id=RegionOne) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:23.447535 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9a1e60-13d9-4f21-aed6-d334eeeb2a9a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:23.449008 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9a1e60-13d9-4f21-aed6-d334eeeb2a9a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:23.461306 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 457/942] 10.222.0.20 () {56 vars in 1251 bytes} [Sat Jun 18 04:06:23 2022] GET /identity/v3/endpoints?service_id=daef65ff6f1c45eba353652b0abecc9e&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:23.462366 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9a1e60-13d9-4f21-aed6-d334eeeb2a9a None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:23.574054 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c5b85a-da08-489b-bd82-a49c6093cece None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:23.605130 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9a1e60-13d9-4f21-aed6-d334eeeb2a9a None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:23.613630 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9bbc12-73d2-4b31-b433-b2d1eed73b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:23.614302 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bbc12-73d2-4b31-b433-b2d1eed73b66 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:23.614583 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bbc12-73d2-4b31-b433-b2d1eed73b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:23.614859 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bbc12-73d2-4b31-b433-b2d1eed73b66 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:23.615609 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9bbc12-73d2-4b31-b433-b2d1eed73b66 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:23.617197 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9bbc12-73d2-4b31-b433-b2d1eed73b66 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:23.642567 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 486/943] 10.222.0.20 () {60 vars in 1144 bytes} [Sat Jun 18 04:06:23 2022] POST /identity/v3/endpoints => generated 347 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 04:06:23.654445 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c2e03-1cdc-4ff1-bbeb-fa9d5ff7e21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:23.655201 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c2e03-1cdc-4ff1-bbeb-fa9d5ff7e21f None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:23.655548 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c2e03-1cdc-4ff1-bbeb-fa9d5ff7e21f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:23.655926 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c2e03-1cdc-4ff1-bbeb-fa9d5ff7e21f None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:23.656786 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3c2e03-1cdc-4ff1-bbeb-fa9d5ff7e21f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:23.658340 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3c2e03-1cdc-4ff1-bbeb-fa9d5ff7e21f None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:23.666379 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 458/944] 10.222.0.20 () {56 vars in 1087 bytes} [Sat Jun 18 04:06:23 2022] GET /identity/v3/services => generated 1497 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 04:06:23.723251 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5da864-dbc9-48f4-884c-1e3d5e5fb7c9 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:23.723642 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5da864-dbc9-48f4-884c-1e3d5e5fb7c9 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:23.723990 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5da864-dbc9-48f4-884c-1e3d5e5fb7c9 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:23.725916 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 487/945] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:06:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:06:23.732248 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27198ee7-0d08-4f4b-bf73-4572d18794d4 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:23.732839 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27198ee7-0d08-4f4b-bf73-4572d18794d4 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:23.733277 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27198ee7-0d08-4f4b-bf73-4572d18794d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:23.743120 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:23.755958 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-27198ee7-0d08-4f4b-bf73-4572d18794d4 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:06:23.757587 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-27198ee7-0d08-4f4b-bf73-4572d18794d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:06:23.848208 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 459/946] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:06:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 04:06:23.872526 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5da864-dbc9-48f4-884c-1e3d5e5fb7c9 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:23.906056 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:23.994870 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5da864-dbc9-48f4-884c-1e3d5e5fb7c9 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:24.030087 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f53c1-a9b6-46cc-ba8f-1cd134945ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:24.031063 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f53c1-a9b6-46cc-ba8f-1cd134945ea7 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:24.031707 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f53c1-a9b6-46cc-ba8f-1cd134945ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:24.032152 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f53c1-a9b6-46cc-ba8f-1cd134945ea7 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:24.033074 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82f53c1-a9b6-46cc-ba8f-1cd134945ea7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:24.034743 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82f53c1-a9b6-46cc-ba8f-1cd134945ea7 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:24.036298 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: WARNING keystone.server.flask.common [None req-b82f53c1-a9b6-46cc-ba8f-1cd134945ea7 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 18 04:06:24.059945 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.sql.core [None req-b82f53c1-a9b6-46cc-ba8f-1cd134945ea7 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 18 04:06:24.059945 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 18 04:06:24.059945 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [parameters: {'id': 'cfad6f9565404059b5581ff722b8db74', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 18 04:06:24.059945 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80240) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 18 04:06:24.067880 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-b82f53c1-a9b6-46cc-ba8f-1cd134945ea7 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id cfad6f9565404059b5581ff722b8db74.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id cfad6f9565404059b5581ff722b8db74. Jun 18 04:06:24.067880 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:24.067880 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 18 04:06:24.067880 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 18 04:06:24.067880 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 18 04:06:24.067880 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 18 04:06:24.067880 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 18 04:06:24.067880 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application result = self._query(query) Jun 18 04:06:24.067880 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 18 04:06:24.067880 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application conn.query(q) Jun 18 04:06:24.067880 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 18 04:06:24.067880 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 18 04:06:24.067880 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 18 04:06:24.068741 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application result.read() Jun 18 04:06:24.068741 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 18 04:06:24.068741 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 18 04:06:24.068741 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 18 04:06:24.068741 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 18 04:06:24.068741 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 18 04:06:24.068741 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 18 04:06:24.068741 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 18 04:06:24.068741 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 18 04:06:24.068741 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 18 04:06:24.068741 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:24.068741 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 18 04:06:24.068741 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:24.068741 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:24.068741 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 18 04:06:24.068741 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 18 04:06:24.068741 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 18 04:06:24.068741 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 18 04:06:24.069686 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 18 04:06:24.069686 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application next(self.gen) Jun 18 04:06:24.069686 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 18 04:06:24.069686 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application yield resource Jun 18 04:06:24.069686 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 18 04:06:24.069686 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application next(self.gen) Jun 18 04:06:24.069686 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 18 04:06:24.069686 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self.session.rollback() Jun 18 04:06:24.069686 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 18 04:06:24.069686 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self.force_reraise() Jun 18 04:06:24.069686 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 18 04:06:24.069686 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise self.value Jun 18 04:06:24.069686 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 18 04:06:24.069686 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 18 04:06:24.069686 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 18 04:06:24.069686 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application session.commit() Jun 18 04:06:24.069686 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 18 04:06:24.070574 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 18 04:06:24.070574 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 18 04:06:24.070574 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._prepare_impl() Jun 18 04:06:24.070574 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 18 04:06:24.070574 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self.session.flush() Jun 18 04:06:24.070574 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 18 04:06:24.070574 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._flush(objects) Jun 18 04:06:24.070574 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 18 04:06:24.070574 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 18 04:06:24.070574 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 18 04:06:24.070574 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application compat.raise_( Jun 18 04:06:24.070574 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 18 04:06:24.070574 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception Jun 18 04:06:24.070574 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 18 04:06:24.070574 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application flush_context.execute() Jun 18 04:06:24.070574 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 18 04:06:24.070574 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rec.execute(self) Jun 18 04:06:24.071519 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 18 04:06:24.071519 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 18 04:06:24.071519 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 18 04:06:24.071519 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 18 04:06:24.071519 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 18 04:06:24.071519 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 18 04:06:24.071519 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 18 04:06:24.071519 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 18 04:06:24.071519 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 18 04:06:24.071519 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 18 04:06:24.071519 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 18 04:06:24.071519 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 18 04:06:24.071519 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 18 04:06:24.071519 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 18 04:06:24.071519 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 18 04:06:24.072344 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 18 04:06:24.072344 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 18 04:06:24.072344 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception Jun 18 04:06:24.072344 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 18 04:06:24.072344 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 18 04:06:24.072344 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 18 04:06:24.072344 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 18 04:06:24.072344 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 18 04:06:24.072344 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application result = self._query(query) Jun 18 04:06:24.072344 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 18 04:06:24.072344 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application conn.query(q) Jun 18 04:06:24.072344 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 18 04:06:24.072344 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 18 04:06:24.072344 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 18 04:06:24.072344 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application result.read() Jun 18 04:06:24.072344 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 18 04:06:24.072344 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 18 04:06:24.074994 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 18 04:06:24.074994 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 18 04:06:24.074994 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 18 04:06:24.074994 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 18 04:06:24.074994 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 18 04:06:24.074994 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 18 04:06:24.074994 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 18 04:06:24.074994 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 18 04:06:24.074994 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [parameters: {'id': 'cfad6f9565404059b5581ff722b8db74', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 18 04:06:24.074994 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 18 04:06:24.074994 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:24.074994 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 04:06:24.074994 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:24.074994 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:24.074994 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 18 04:06:24.076910 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 18 04:06:24.076910 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 18 04:06:24.076910 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 18 04:06:24.076910 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 18 04:06:24.076910 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:24.076910 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 04:06:24.076910 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:24.076910 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:24.076910 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:24.076910 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:24.076910 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:24.076910 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:24.076910 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:24.076910 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:24.076910 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:24.076910 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:24.076910 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:24.079030 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:24.079030 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 18 04:06:24.079030 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 18 04:06:24.079030 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:24.079030 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:24.079030 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 18 04:06:24.079030 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 18 04:06:24.079030 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id cfad6f9565404059b5581ff722b8db74. Jun 18 04:06:24.079030 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:24.079030 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 488/947] 10.222.0.20 () {60 vars in 1140 bytes} [Sat Jun 18 04:06:23 2022] POST /identity/v3/projects => generated 262 bytes in 197 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:24.085303 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27198ee7-0d08-4f4b-bf73-4572d18794d4 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:24.199885 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27198ee7-0d08-4f4b-bf73-4572d18794d4 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:24.239520 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f1afb-ade0-4628-aa85-7632561301f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:24.240331 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f1afb-ade0-4628-aa85-7632561301f3 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:24.240631 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f1afb-ade0-4628-aa85-7632561301f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:24.240906 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f1afb-ade0-4628-aa85-7632561301f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:24.242929 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:24.248753 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0f1afb-ade0-4628-aa85-7632561301f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:24.250241 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0f1afb-ade0-4628-aa85-7632561301f3 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:24.267624 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-4a0f1afb-ade0-4628-aa85-7632561301f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 04:06:24.267624 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:24.267624 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:24.267624 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:24.267624 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:24.267624 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:24.267624 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:24.267624 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:24.267624 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:24.267624 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:24.267624 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:24.267624 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:24.267624 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 04:06:24.267624 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 04:06:24.267624 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 04:06:24.268548 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 04:06:24.268548 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:24.268548 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:24.268548 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:24.268548 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:24.268548 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:24.268548 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:24.268548 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:24.268548 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:24.268548 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:24.268548 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:24.268548 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:24.268548 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:24.268548 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:24.268548 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:24.268548 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:24.268548 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:24.269466 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 04:06:24.269466 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 04:06:24.269466 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 04:06:24.269466 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 04:06:24.269466 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 04:06:24.269466 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 04:06:24.269466 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 04:06:24.269466 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:24.269466 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 460/948] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Jun 18 04:06:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:24.276757 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f53c1-a9b6-46cc-ba8f-1cd134945ea7 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:24.363691 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:24.381220 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f53c1-a9b6-46cc-ba8f-1cd134945ea7 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:24.414990 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef9f3f-dd67-409f-aeda-07b5309255d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:24.415665 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef9f3f-dd67-409f-aeda-07b5309255d1 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:24.415940 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef9f3f-dd67-409f-aeda-07b5309255d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:24.416208 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef9f3f-dd67-409f-aeda-07b5309255d1 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:24.417002 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef9f3f-dd67-409f-aeda-07b5309255d1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:24.417300 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef9f3f-dd67-409f-aeda-07b5309255d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:24.418950 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef9f3f-dd67-409f-aeda-07b5309255d1 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:24.439504 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 489/949] 10.222.0.20 () {56 vars in 1112 bytes} [Sat Jun 18 04:06:24 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:25.521630 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637ccad-051b-46c6-a64a-7f156a563c19 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:25.522188 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637ccad-051b-46c6-a64a-7f156a563c19 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:25.522188 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637ccad-051b-46c6-a64a-7f156a563c19 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:25.523735 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 461/950] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:06:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:06:25.529481 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7ba70-8ef0-41a4-b6b0-1d539e390cc6 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:25.530297 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7ba70-8ef0-41a4-b6b0-1d539e390cc6 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:25.530769 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7ba70-8ef0-41a4-b6b0-1d539e390cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:25.548604 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-9eb7ba70-8ef0-41a4-b6b0-1d539e390cc6 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:06:25.550410 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9eb7ba70-8ef0-41a4-b6b0-1d539e390cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:06:25.626314 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 490/951] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:06:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 18 04:06:25.649645 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f637ccad-051b-46c6-a64a-7f156a563c19 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:25.746026 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1e37d-7cb3-4826-917e-9ffe50194624 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:25.746316 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1e37d-7cb3-4826-917e-9ffe50194624 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:25.746594 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1e37d-7cb3-4826-917e-9ffe50194624 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:25.747984 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 491/952] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:06:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:06:25.754672 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d0ff0-72c0-4bfc-9016-a3fed1b7a0ec None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:25.754954 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d0ff0-72c0-4bfc-9016-a3fed1b7a0ec None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:25.755233 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d0ff0-72c0-4bfc-9016-a3fed1b7a0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:25.759801 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f637ccad-051b-46c6-a64a-7f156a563c19 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:25.780016 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-ab6d0ff0-72c0-4bfc-9016-a3fed1b7a0ec None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:06:25.782236 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ab6d0ff0-72c0-4bfc-9016-a3fed1b7a0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:06:25.794941 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8747a8d6-c29e-4282-a167-7ddd418f5843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:25.795759 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747a8d6-c29e-4282-a167-7ddd418f5843 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:25.796033 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747a8d6-c29e-4282-a167-7ddd418f5843 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:25.796300 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747a8d6-c29e-4282-a167-7ddd418f5843 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:25.807718 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8747a8d6-c29e-4282-a167-7ddd418f5843 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 04:06:25.816464 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-8747a8d6-c29e-4282-a167-7ddd418f5843 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 18 04:06:25.816464 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:25.816464 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:25.816464 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:25.816464 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:25.816464 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:25.816464 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:25.816464 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:25.816464 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:25.816464 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:25.816464 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:25.816464 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:25.816464 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 04:06:25.816464 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 04:06:25.816464 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 04:06:25.816464 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 04:06:25.817440 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 04:06:25.817440 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 04:06:25.817440 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 04:06:25.817440 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 04:06:25.817440 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:25.817440 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:25.817440 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:25.817440 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:25.817440 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:25.817440 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:25.817440 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:25.817440 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:25.817440 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:25.817440 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:25.817440 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:25.817440 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:25.818287 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:25.818287 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:25.818287 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:25.818287 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:25.818287 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 04:06:25.818287 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 04:06:25.818287 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 04:06:25.818287 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 04:06:25.818287 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 04:06:25.818287 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 04:06:25.818287 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 18 04:06:25.818287 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:25.822644 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 462/953] 10.222.0.20 () {56 vars in 1120 bytes} [Sat Jun 18 04:06:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:25.823961 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8747a8d6-c29e-4282-a167-7ddd418f5843 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:25.868596 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 492/954] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:06:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 18 04:06:25.868596 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbfd34-df17-497c-9a3a-8d7191928001 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:25.868596 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbfd34-df17-497c-9a3a-8d7191928001 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:25.868596 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbfd34-df17-497c-9a3a-8d7191928001 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:25.868596 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 493/955] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:06:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 18 04:06:25.874065 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae637f0-8ae9-403d-8182-5bead445e112 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:25.874350 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae637f0-8ae9-403d-8182-5bead445e112 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:25.874626 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae637f0-8ae9-403d-8182-5bead445e112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:25.888400 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:25.893374 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:25.894862 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-3ae637f0-8ae9-403d-8182-5bead445e112 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:06:25.896021 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-3ae637f0-8ae9-403d-8182-5bead445e112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:06:25.939531 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8747a8d6-c29e-4282-a167-7ddd418f5843 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:25.976819 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 494/956] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:06:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 18 04:06:25.976819 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae637f0-8ae9-403d-8182-5bead445e112 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:25.985949 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd01579-0c03-46e9-b881-c14a9c7cb5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:25.987213 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd01579-0c03-46e9-b881-c14a9c7cb5dd None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:25.987638 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd01579-0c03-46e9-b881-c14a9c7cb5dd None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:25.988321 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd01579-0c03-46e9-b881-c14a9c7cb5dd None admin] PATH_INFO: `/v3/roles` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:25.989253 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd01579-0c03-46e9-b881-c14a9c7cb5dd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:25.989938 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd01579-0c03-46e9-b881-c14a9c7cb5dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:25.992059 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd01579-0c03-46e9-b881-c14a9c7cb5dd None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:26.003993 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 463/957] 10.222.0.20 () {56 vars in 1115 bytes} [Sat Jun 18 04:06:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:06:26.005784 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd01579-0c03-46e9-b881-c14a9c7cb5dd None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:26.100199 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae637f0-8ae9-403d-8182-5bead445e112 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:26.126020 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd01579-0c03-46e9-b881-c14a9c7cb5dd None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:26.144189 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:26.149987 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a7bd2-5ff0-4585-b586-05cfe8ab4d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:26.151689 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a7bd2-5ff0-4585-b586-05cfe8ab4d66 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:26.152102 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a7bd2-5ff0-4585-b586-05cfe8ab4d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:26.152509 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a7bd2-5ff0-4585-b586-05cfe8ab4d66 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:26.153595 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a7bd2-5ff0-4585-b586-05cfe8ab4d66 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:26.155820 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a7bd2-5ff0-4585-b586-05cfe8ab4d66 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:26.158769 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:26.165445 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c3216-9383-4a9a-9627-68fd6a3abdfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:26.166372 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c3216-9383-4a9a-9627-68fd6a3abdfe None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:26.166745 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c3216-9383-4a9a-9627-68fd6a3abdfe None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:26.167111 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c3216-9383-4a9a-9627-68fd6a3abdfe None admin] PATH_INFO: `/v3/services/compute` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:26.167921 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c3216-9383-4a9a-9627-68fd6a3abdfe None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:26.169426 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c3216-9383-4a9a-9627-68fd6a3abdfe None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:26.173110 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-877a7bd2-5ff0-4585-b586-05cfe8ab4d66 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 18 04:06:26.173110 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:26.173110 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 18 04:06:26.173110 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 18 04:06:26.173110 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 18 04:06:26.173110 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 18 04:06:26.173110 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 18 04:06:26.173110 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 04:06:26.173110 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 18 04:06:26.173110 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:26.173110 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 04:06:26.173110 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:26.173110 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:26.173110 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:26.173110 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:26.173110 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:26.173110 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:26.174502 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:26.174502 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:26.174502 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:26.174502 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:26.174502 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:26.174502 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:26.174502 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 18 04:06:26.174502 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 18 04:06:26.174502 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 18 04:06:26.174502 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 18 04:06:26.174502 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:26.174502 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:26.174502 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:26.174502 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:26.174502 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:26.174502 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:26.175601 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:26.175601 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:26.175601 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:26.175601 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:26.175601 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:26.175601 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:26.175601 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:26.175601 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:26.175601 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:26.175601 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:26.175601 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 18 04:06:26.175601 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 04:06:26.175601 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 18 04:06:26.175601 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:26.177920 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 495/958] 10.222.0.20 () {56 vars in 1126 bytes} [Sat Jun 18 04:06:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:26.183109 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a7bd2-5ff0-4585-b586-05cfe8ab4d66 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:26.197016 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-7e4c3216-9383-4a9a-9627-68fd6a3abdfe None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 18 04:06:26.197016 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:26.197016 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 18 04:06:26.197016 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 18 04:06:26.197016 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 18 04:06:26.197016 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 18 04:06:26.197016 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 18 04:06:26.197016 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 04:06:26.197016 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 18 04:06:26.197016 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:26.197016 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 04:06:26.197016 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:26.197016 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:26.197016 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:26.197016 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:26.197016 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:26.197016 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:26.198075 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:26.198075 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:26.198075 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:26.198075 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:26.198075 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:26.198075 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:26.198075 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 18 04:06:26.198075 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 18 04:06:26.198075 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 18 04:06:26.198075 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 18 04:06:26.198075 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:26.198075 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:26.198075 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:26.198075 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:26.198075 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:26.198075 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:26.198983 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:26.198983 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:26.198983 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:26.198983 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:26.198983 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:26.198983 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:26.198983 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:26.198983 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:26.198983 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:26.198983 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:26.198983 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 18 04:06:26.198983 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 04:06:26.198983 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 18 04:06:26.198983 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:26.198983 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 464/959] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Jun 18 04:06:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:26.204073 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c3216-9383-4a9a-9627-68fd6a3abdfe None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:26.306493 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a7bd2-5ff0-4585-b586-05cfe8ab4d66 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:26.329205 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c3216-9383-4a9a-9627-68fd6a3abdfe None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:26.347175 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258f340-0f57-4275-b5ba-a78917d460ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:26.348234 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258f340-0f57-4275-b5ba-a78917d460ff None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:26.348867 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258f340-0f57-4275-b5ba-a78917d460ff None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:26.349137 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258f340-0f57-4275-b5ba-a78917d460ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:26.364034 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d258f340-0f57-4275-b5ba-a78917d460ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:26.365440 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d258f340-0f57-4275-b5ba-a78917d460ff None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:26.366968 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68164cc8-73a6-48d2-a6d6-d245965ed29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:26.367900 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68164cc8-73a6-48d2-a6d6-d245965ed29f None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:26.368380 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68164cc8-73a6-48d2-a6d6-d245965ed29f None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:26.368841 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68164cc8-73a6-48d2-a6d6-d245965ed29f None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:26.369641 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68164cc8-73a6-48d2-a6d6-d245965ed29f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:26.370046 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68164cc8-73a6-48d2-a6d6-d245965ed29f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:26.371560 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68164cc8-73a6-48d2-a6d6-d245965ed29f None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:26.381641 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 465/960] 10.222.0.20 () {56 vars in 1122 bytes} [Sat Jun 18 04:06:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:26.381641 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68164cc8-73a6-48d2-a6d6-d245965ed29f None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:26.392304 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-d258f340-0f57-4275-b5ba-a78917d460ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:06:26.392304 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:26.392304 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:26.392304 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:26.392304 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:26.392304 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:26.392304 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:26.392304 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:26.392304 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:26.392304 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:26.392304 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:26.392304 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:26.392304 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:06:26.392304 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:06:26.392304 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:06:26.393287 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:06:26.393287 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:26.393287 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:26.393287 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:26.393287 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:26.393287 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:26.393287 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:26.393287 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:26.393287 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:26.393287 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:26.393287 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:26.393287 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:26.393287 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:26.393287 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:26.393287 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:26.393287 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:26.393287 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:26.394256 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:06:26.394256 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:06:26.394256 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:06:26.394256 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:26.396950 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 496/961] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:06:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:26.397908 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258f340-0f57-4275-b5ba-a78917d460ff None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:26.450855 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:26.468614 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:26.510880 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68164cc8-73a6-48d2-a6d6-d245965ed29f None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:26.521688 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258f340-0f57-4275-b5ba-a78917d460ff None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:26.544661 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b52f155-a4e6-47f7-b4d1-06a2d5acc5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:26.545324 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52f155-a4e6-47f7-b4d1-06a2d5acc5b9 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:26.545600 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52f155-a4e6-47f7-b4d1-06a2d5acc5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:26.545868 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52f155-a4e6-47f7-b4d1-06a2d5acc5b9 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:26.546573 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b52f155-a4e6-47f7-b4d1-06a2d5acc5b9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:26.546873 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b52f155-a4e6-47f7-b4d1-06a2d5acc5b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:26.548249 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b52f155-a4e6-47f7-b4d1-06a2d5acc5b9 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:26.553076 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 466/962] 10.222.0.20 () {56 vars in 1112 bytes} [Sat Jun 18 04:06:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:26.553860 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b52f155-a4e6-47f7-b4d1-06a2d5acc5b9 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:26.559181 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa038d86-3d97-4429-9d3f-d149268cb9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:26.559852 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa038d86-3d97-4429-9d3f-d149268cb9e6 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:26.560127 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa038d86-3d97-4429-9d3f-d149268cb9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:26.560396 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa038d86-3d97-4429-9d3f-d149268cb9e6 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:26.561130 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa038d86-3d97-4429-9d3f-d149268cb9e6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:26.561431 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa038d86-3d97-4429-9d3f-d149268cb9e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:26.562786 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa038d86-3d97-4429-9d3f-d149268cb9e6 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:26.567817 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 497/963] 10.222.0.20 () {56 vars in 1122 bytes} [Sat Jun 18 04:06:26 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:26.569147 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c93d638-4962-47b8-892b-aab679b043a7 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:26.569642 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c93d638-4962-47b8-892b-aab679b043a7 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:26.569752 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c93d638-4962-47b8-892b-aab679b043a7 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:26.570958 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 498/964] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:06:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:06:26.571633 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c93d638-4962-47b8-892b-aab679b043a7 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:26.655381 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b52f155-a4e6-47f7-b4d1-06a2d5acc5b9 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:26.664104 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:26.672242 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c93d638-4962-47b8-892b-aab679b043a7 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:26.685852 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:26.690442 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4848cf6-1575-4c58-8890-ccb9961c2c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:26.691102 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4848cf6-1575-4c58-8890-ccb9961c2c16 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:26.691375 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4848cf6-1575-4c58-8890-ccb9961c2c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:26.691641 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4848cf6-1575-4c58-8890-ccb9961c2c16 None admin] PATH_INFO: `/v3/domains` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:26.692355 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4848cf6-1575-4c58-8890-ccb9961c2c16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:26.692685 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4848cf6-1575-4c58-8890-ccb9961c2c16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:26.694056 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4848cf6-1575-4c58-8890-ccb9961c2c16 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:26.705641 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed942c7-375d-42b7-8634-942425a49cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:26.705778 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 467/965] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:06:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:26.706296 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed942c7-375d-42b7-8634-942425a49cb6 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:26.706473 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4848cf6-1575-4c58-8890-ccb9961c2c16 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:26.706568 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed942c7-375d-42b7-8634-942425a49cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:26.706836 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed942c7-375d-42b7-8634-942425a49cb6 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:26.707539 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed942c7-375d-42b7-8634-942425a49cb6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:26.707842 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed942c7-375d-42b7-8634-942425a49cb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:26.709234 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed942c7-375d-42b7-8634-942425a49cb6 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:26.713790 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 499/966] 10.222.0.20 () {56 vars in 1112 bytes} [Sat Jun 18 04:06:26 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:26.714969 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac67de6-ed2c-44b0-85b1-bd11e4b4adc1 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:26.715247 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac67de6-ed2c-44b0-85b1-bd11e4b4adc1 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:26.715518 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac67de6-ed2c-44b0-85b1-bd11e4b4adc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:26.733292 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-bac67de6-ed2c-44b0-85b1-bd11e4b4adc1 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:06:26.734913 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-bac67de6-ed2c-44b0-85b1-bd11e4b4adc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:06:26.809455 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 500/967] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:06:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 04:06:26.821667 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac67de6-ed2c-44b0-85b1-bd11e4b4adc1 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:26.830908 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4848cf6-1575-4c58-8890-ccb9961c2c16 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:26.869654 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e2e84-c8d4-4621-b7e9-1d69c969eacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:26.870656 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e2e84-c8d4-4621-b7e9-1d69c969eacf None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:26.870944 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e2e84-c8d4-4621-b7e9-1d69c969eacf None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:26.871224 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e2e84-c8d4-4621-b7e9-1d69c969eacf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:26.872292 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198e2e84-c8d4-4621-b7e9-1d69c969eacf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:26.873983 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198e2e84-c8d4-4621-b7e9-1d69c969eacf None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:26.898998 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 468/968] 10.222.0.20 () {60 vars in 1144 bytes} [Sat Jun 18 04:06:26 2022] POST /identity/v3/endpoints => generated 349 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 04:06:26.899817 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e2e84-c8d4-4621-b7e9-1d69c969eacf None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:26.942258 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:26.944694 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac67de6-ed2c-44b0-85b1-bd11e4b4adc1 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:26.962605 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:27.011081 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c779d7-b756-46ed-b5d2-6e0e669289cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:27.012201 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c779d7-b756-46ed-b5d2-6e0e669289cc None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:27.012666 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c779d7-b756-46ed-b5d2-6e0e669289cc None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:27.013096 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c779d7-b756-46ed-b5d2-6e0e669289cc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:27.021777 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c779d7-b756-46ed-b5d2-6e0e669289cc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:27.023509 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c779d7-b756-46ed-b5d2-6e0e669289cc None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:27.040356 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-e0c779d7-b756-46ed-b5d2-6e0e669289cc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 18 04:06:27.040356 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:27.040356 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:27.040356 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:27.040356 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:27.040356 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:27.040356 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:27.040356 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:27.040356 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:27.040356 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:27.040356 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:27.040356 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:27.040356 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 04:06:27.040356 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 04:06:27.040356 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 04:06:27.040356 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 04:06:27.041581 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:27.041581 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:27.041581 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 04:06:27.041581 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 04:06:27.041581 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 04:06:27.041581 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 04:06:27.041581 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:27.041581 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:27.041581 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:27.041581 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:27.041581 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:27.041581 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:27.041581 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:27.041581 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:27.041581 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:27.041581 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:27.041581 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:27.041581 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:27.042533 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:27.042533 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:27.042533 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 04:06:27.042533 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 04:06:27.042533 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 04:06:27.042533 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 04:06:27.042533 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 04:06:27.042533 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 04:06:27.042533 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 18 04:06:27.042533 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:27.045253 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 501/969] 10.222.0.20 () {56 vars in 1117 bytes} [Sat Jun 18 04:06:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:27.047812 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e2e84-c8d4-4621-b7e9-1d69c969eacf None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:27.056630 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c779d7-b756-46ed-b5d2-6e0e669289cc None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:27.092889 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b8a74a-3681-4d74-9f7c-5a2f746b7982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:27.093846 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8a74a-3681-4d74-9f7c-5a2f746b7982 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:27.094292 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8a74a-3681-4d74-9f7c-5a2f746b7982 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:27.094565 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8a74a-3681-4d74-9f7c-5a2f746b7982 None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:27.095273 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b8a74a-3681-4d74-9f7c-5a2f746b7982 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:27.096974 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b8a74a-3681-4d74-9f7c-5a2f746b7982 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:27.098358 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: WARNING keystone.server.flask.common [None req-89b8a74a-3681-4d74-9f7c-5a2f746b7982 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 18 04:06:27.113321 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.sql.core [None req-89b8a74a-3681-4d74-9f7c-5a2f746b7982 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 18 04:06:27.113321 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 18 04:06:27.113321 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [parameters: {'user_id': '221d49275f2241658b8e08e5f9fe3d27', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 18 04:06:27.113321 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80241) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 18 04:06:27.130499 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-89b8a74a-3681-4d74-9f7c-5a2f746b7982 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 18 04:06:27.130499 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:27.130499 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 18 04:06:27.130499 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 18 04:06:27.130499 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 18 04:06:27.130499 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 18 04:06:27.130499 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 18 04:06:27.130499 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application result = self._query(query) Jun 18 04:06:27.130499 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 18 04:06:27.130499 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application conn.query(q) Jun 18 04:06:27.130499 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 18 04:06:27.130499 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 18 04:06:27.130499 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 18 04:06:27.130499 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application result.read() Jun 18 04:06:27.130499 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 18 04:06:27.131466 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 18 04:06:27.131466 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 18 04:06:27.131466 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 18 04:06:27.131466 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 18 04:06:27.131466 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 18 04:06:27.131466 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 18 04:06:27.131466 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 18 04:06:27.131466 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 18 04:06:27.131466 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:27.131466 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 18 04:06:27.131466 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:27.131466 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:27.131466 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 18 04:06:27.131466 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 18 04:06:27.131466 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 18 04:06:27.131466 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 18 04:06:27.131466 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 18 04:06:27.131466 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application next(self.gen) Jun 18 04:06:27.132716 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 18 04:06:27.132716 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application yield resource Jun 18 04:06:27.132716 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 18 04:06:27.132716 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application next(self.gen) Jun 18 04:06:27.132716 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 18 04:06:27.132716 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self.session.rollback() Jun 18 04:06:27.132716 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 18 04:06:27.132716 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self.force_reraise() Jun 18 04:06:27.132716 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 18 04:06:27.132716 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise self.value Jun 18 04:06:27.132716 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 18 04:06:27.132716 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 18 04:06:27.132716 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 18 04:06:27.132716 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application session.commit() Jun 18 04:06:27.132716 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 18 04:06:27.132716 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 18 04:06:27.132716 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 18 04:06:27.134222 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._prepare_impl() Jun 18 04:06:27.134222 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 18 04:06:27.134222 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self.session.flush() Jun 18 04:06:27.134222 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 18 04:06:27.134222 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._flush(objects) Jun 18 04:06:27.134222 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 18 04:06:27.134222 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 18 04:06:27.134222 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 18 04:06:27.134222 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application compat.raise_( Jun 18 04:06:27.134222 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 18 04:06:27.134222 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception Jun 18 04:06:27.134222 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 18 04:06:27.134222 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application flush_context.execute() Jun 18 04:06:27.134222 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 18 04:06:27.134222 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rec.execute(self) Jun 18 04:06:27.134222 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 18 04:06:27.134222 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 18 04:06:27.135327 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 18 04:06:27.135327 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 18 04:06:27.135327 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 18 04:06:27.135327 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 18 04:06:27.135327 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 18 04:06:27.135327 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 18 04:06:27.135327 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 18 04:06:27.135327 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 18 04:06:27.135327 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 18 04:06:27.135327 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 18 04:06:27.135327 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 18 04:06:27.135327 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 18 04:06:27.135327 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 18 04:06:27.135327 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 18 04:06:27.135327 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 18 04:06:27.135327 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception Jun 18 04:06:27.136791 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 18 04:06:27.136791 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 18 04:06:27.136791 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 18 04:06:27.136791 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 18 04:06:27.136791 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 18 04:06:27.136791 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application result = self._query(query) Jun 18 04:06:27.136791 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 18 04:06:27.136791 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application conn.query(q) Jun 18 04:06:27.136791 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 18 04:06:27.136791 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 18 04:06:27.136791 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 18 04:06:27.136791 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application result.read() Jun 18 04:06:27.136791 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 18 04:06:27.136791 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 18 04:06:27.136791 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 18 04:06:27.136791 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 18 04:06:27.137969 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 18 04:06:27.137969 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 18 04:06:27.137969 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 18 04:06:27.137969 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 18 04:06:27.137969 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 18 04:06:27.137969 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 18 04:06:27.137969 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [parameters: {'user_id': '221d49275f2241658b8e08e5f9fe3d27', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 18 04:06:27.137969 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 18 04:06:27.137969 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:27.137969 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 04:06:27.137969 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:27.137969 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:27.137969 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:27.137969 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:27.137969 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:27.139463 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:27.139463 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:27.139463 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:27.139463 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:27.139463 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:27.139463 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:27.139463 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:27.139463 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 18 04:06:27.139463 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 18 04:06:27.139463 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:27.139463 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:27.139463 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 04:06:27.139463 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 04:06:27.139463 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 04:06:27.139463 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 04:06:27.139463 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 18 04:06:27.139463 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 18 04:06:27.141478 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 18 04:06:27.141478 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 18 04:06:27.141478 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 18 04:06:27.141478 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 18 04:06:27.141478 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 18 04:06:27.141478 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:27.141478 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 469/970] 10.222.0.20 () {60 vars in 1131 bytes} [Sat Jun 18 04:06:26 2022] POST /identity/v3/users => generated 160 bytes in 232 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:27.141478 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b8a74a-3681-4d74-9f7c-5a2f746b7982 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:27.190065 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c779d7-b756-46ed-b5d2-6e0e669289cc None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:27.234535 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ca9f1-fa5f-4198-a7de-2cceb528fda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:27.235156 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ca9f1-fa5f-4198-a7de-2cceb528fda1 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:27.235485 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ca9f1-fa5f-4198-a7de-2cceb528fda1 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:27.235754 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ca9f1-fa5f-4198-a7de-2cceb528fda1 None admin] PATH_INFO: `/v3/users` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:27.236679 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168ca9f1-fa5f-4198-a7de-2cceb528fda1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:27.237032 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168ca9f1-fa5f-4198-a7de-2cceb528fda1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:27.238462 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168ca9f1-fa5f-4198-a7de-2cceb528fda1 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:27.242976 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:27.257836 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 502/971] 10.222.0.20 () {56 vars in 1149 bytes} [Sat Jun 18 04:06:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:27.263339 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ca9f1-fa5f-4198-a7de-2cceb528fda1 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:27.271524 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b8a74a-3681-4d74-9f7c-5a2f746b7982 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:27.288840 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:27.326753 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb083eea-42d1-49e9-946d-15db818e4cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:27.327566 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb083eea-42d1-49e9-946d-15db818e4cb7 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:27.327852 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb083eea-42d1-49e9-946d-15db818e4cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:27.328115 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb083eea-42d1-49e9-946d-15db818e4cb7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:27.336259 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb083eea-42d1-49e9-946d-15db818e4cb7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:27.337935 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb083eea-42d1-49e9-946d-15db818e4cb7 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:27.352264 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-bb083eea-42d1-49e9-946d-15db818e4cb7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 18 04:06:27.352264 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:27.352264 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:27.352264 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:27.352264 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:27.352264 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:27.352264 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:27.352264 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:27.352264 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:27.352264 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:27.352264 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:27.352264 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:27.352264 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 04:06:27.352264 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 04:06:27.352264 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 04:06:27.352264 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 04:06:27.353269 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:27.353269 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:27.353269 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 04:06:27.353269 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 04:06:27.353269 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 04:06:27.353269 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 04:06:27.353269 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:27.353269 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:27.353269 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:27.353269 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:27.353269 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:27.353269 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:27.353269 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:27.353269 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:27.353269 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:27.353269 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:27.353269 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:27.353269 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:27.354216 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:27.354216 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:27.354216 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 04:06:27.354216 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 04:06:27.354216 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 04:06:27.354216 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 04:06:27.354216 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 04:06:27.354216 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 04:06:27.354216 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 18 04:06:27.354216 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:27.358316 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 470/972] 10.222.0.20 () {56 vars in 1099 bytes} [Sat Jun 18 04:06:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 04:06:27.359542 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb083eea-42d1-49e9-946d-15db818e4cb7 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:27.388855 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ca9f1-fa5f-4198-a7de-2cceb528fda1 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:27.437847 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4e54f-0b2d-47c9-ae7c-a8bf9064a088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:27.438839 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4e54f-0b2d-47c9-ae7c-a8bf9064a088 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:27.439325 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4e54f-0b2d-47c9-ae7c-a8bf9064a088 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:27.439779 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4e54f-0b2d-47c9-ae7c-a8bf9064a088 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:27.468417 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb083eea-42d1-49e9-946d-15db818e4cb7 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:27.507403 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e498e9c-3dcb-4622-96dc-ff2d76250a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:27.508085 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e498e9c-3dcb-4622-96dc-ff2d76250a0e None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:27.508598 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e498e9c-3dcb-4622-96dc-ff2d76250a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:27.508846 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e498e9c-3dcb-4622-96dc-ff2d76250a0e None admin] PATH_INFO: `/v3/users` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:27.509761 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e498e9c-3dcb-4622-96dc-ff2d76250a0e None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:27.510153 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e498e9c-3dcb-4622-96dc-ff2d76250a0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:27.511704 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e498e9c-3dcb-4622-96dc-ff2d76250a0e None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:27.531828 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b4e54f-0b2d-47c9-ae7c-a8bf9064a088 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:27.533573 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b4e54f-0b2d-47c9-ae7c-a8bf9064a088 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:27.557009 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 471/973] 10.222.0.20 () {56 vars in 1101 bytes} [Sat Jun 18 04:06:27 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:27.564047 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:27.655403 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 503/974] 10.222.0.20 () {58 vars in 1282 bytes} [Sat Jun 18 04:06:27 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 18 04:06:27.661135 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e498e9c-3dcb-4622-96dc-ff2d76250a0e None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:27.666570 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:27.774638 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e498e9c-3dcb-4622-96dc-ff2d76250a0e None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:27.812639 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac3bf1-e77d-49ac-92dd-106010ba7b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:27.813903 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac3bf1-e77d-49ac-92dd-106010ba7b5a None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:27.814389 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac3bf1-e77d-49ac-92dd-106010ba7b5a None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:27.814896 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac3bf1-e77d-49ac-92dd-106010ba7b5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:27.826762 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbac3bf1-e77d-49ac-92dd-106010ba7b5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:27.828375 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbac3bf1-e77d-49ac-92dd-106010ba7b5a None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:27.847960 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-cbac3bf1-e77d-49ac-92dd-106010ba7b5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:06:27.847960 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:27.847960 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:27.847960 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:27.847960 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:27.847960 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:27.847960 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:27.847960 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:27.847960 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:27.847960 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:27.847960 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:27.847960 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:27.847960 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 04:06:27.847960 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 04:06:27.847960 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 04:06:27.849212 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 04:06:27.849212 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:27.849212 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:27.849212 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:27.849212 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:27.849212 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:27.849212 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:27.849212 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:27.849212 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:27.849212 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:27.849212 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:27.849212 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:27.849212 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:27.849212 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:27.849212 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:27.849212 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:27.849212 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:27.850134 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 04:06:27.850134 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 04:06:27.850134 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 04:06:27.850134 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:27.850134 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 472/975] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:06:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:27.854893 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4e54f-0b2d-47c9-ae7c-a8bf9064a088 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:27.962434 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4e54f-0b2d-47c9-ae7c-a8bf9064a088 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:27.987901 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:28.000398 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95987b1d-5a70-4ecb-b35c-b7dfa0363cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:28.001238 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95987b1d-5a70-4ecb-b35c-b7dfa0363cd5 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:28.001507 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95987b1d-5a70-4ecb-b35c-b7dfa0363cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:28.001776 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95987b1d-5a70-4ecb-b35c-b7dfa0363cd5 None admin] PATH_INFO: `/v3/domains` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:28.002502 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95987b1d-5a70-4ecb-b35c-b7dfa0363cd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:28.002803 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95987b1d-5a70-4ecb-b35c-b7dfa0363cd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:28.004201 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95987b1d-5a70-4ecb-b35c-b7dfa0363cd5 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:28.015924 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 504/976] 10.222.0.20 () {56 vars in 1109 bytes} [Sat Jun 18 04:06:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:06:28.021381 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac3bf1-e77d-49ac-92dd-106010ba7b5a None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:28.084423 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:28.130299 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac3bf1-e77d-49ac-92dd-106010ba7b5a None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:28.176061 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9dc412-7400-42a2-955f-cb46cfbc666b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:28.176931 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9dc412-7400-42a2-955f-cb46cfbc666b None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:28.177211 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9dc412-7400-42a2-955f-cb46cfbc666b None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:28.177480 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9dc412-7400-42a2-955f-cb46cfbc666b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:28.184295 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9dc412-7400-42a2-955f-cb46cfbc666b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:28.185764 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9dc412-7400-42a2-955f-cb46cfbc666b None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:28.199540 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-cb9dc412-7400-42a2-955f-cb46cfbc666b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 04:06:28.199540 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:28.199540 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:28.199540 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:28.199540 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:28.199540 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:28.199540 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:28.199540 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:28.199540 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:28.199540 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:28.199540 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:28.199540 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:28.199540 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 04:06:28.199540 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 04:06:28.199540 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 04:06:28.200438 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 04:06:28.200438 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:28.200438 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:28.200438 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:28.200438 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:28.200438 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:28.200438 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:28.200438 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:28.200438 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:28.200438 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:28.200438 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:28.200438 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:28.200438 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:28.200438 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:28.200438 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:28.200438 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:28.200438 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:28.206316 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 04:06:28.206316 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 04:06:28.206316 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 04:06:28.206316 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 04:06:28.206316 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 04:06:28.206316 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 04:06:28.206316 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 04:06:28.206316 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:28.206316 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 473/977] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Jun 18 04:06:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:28.207363 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95987b1d-5a70-4ecb-b35c-b7dfa0363cd5 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:28.310250 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95987b1d-5a70-4ecb-b35c-b7dfa0363cd5 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:28.344972 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6446302c-41e0-45a7-a354-49afbd0d4214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:28.345542 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446302c-41e0-45a7-a354-49afbd0d4214 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:28.345790 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446302c-41e0-45a7-a354-49afbd0d4214 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:28.346083 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446302c-41e0-45a7-a354-49afbd0d4214 None admin] PATH_INFO: `/v3/projects` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:28.346849 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6446302c-41e0-45a7-a354-49afbd0d4214 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:28.347157 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6446302c-41e0-45a7-a354-49afbd0d4214 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:28.348589 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6446302c-41e0-45a7-a354-49afbd0d4214 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:28.366356 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 505/978] 10.222.0.20 () {56 vars in 1148 bytes} [Sat Jun 18 04:06:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:28.367746 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9dc412-7400-42a2-955f-cb46cfbc666b None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:28.471849 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9dc412-7400-42a2-955f-cb46cfbc666b None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:28.489259 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:28.509583 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34431dfe-5fe7-4864-a158-ca1e49628892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:28.510245 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34431dfe-5fe7-4864-a158-ca1e49628892 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:28.510521 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34431dfe-5fe7-4864-a158-ca1e49628892 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:28.510792 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34431dfe-5fe7-4864-a158-ca1e49628892 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:28.511619 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34431dfe-5fe7-4864-a158-ca1e49628892 None admin] RBAC: Adding query filter params (role.id=d4273747919d492bb44d9c0f6ee20e91, scope.project.id=9649aee8c5554102bc4193003300a3ad, user.id=310a7b366bee40f38960d76e56b52986) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:28.512228 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34431dfe-5fe7-4864-a158-ca1e49628892 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:28.513400 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34431dfe-5fe7-4864-a158-ca1e49628892 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:28.528664 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 474/979] 10.222.0.20 () {56 vars in 1374 bytes} [Sat Jun 18 04:06:28 2022] GET /identity/v3/role_assignments?user.id=310a7b366bee40f38960d76e56b52986&scope.project.id=9649aee8c5554102bc4193003300a3ad&role.id=d4273747919d492bb44d9c0f6ee20e91 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:28.766320 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8857589-92d3-4e8f-a61b-46fc45822ce6 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:28.766868 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8857589-92d3-4e8f-a61b-46fc45822ce6 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:28.766868 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8857589-92d3-4e8f-a61b-46fc45822ce6 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:28.768217 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 506/980] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:06:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:06:28.773847 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721cc2b-5c06-4542-b55c-20c41f0d3956 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:28.774289 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721cc2b-5c06-4542-b55c-20c41f0d3956 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:28.774381 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721cc2b-5c06-4542-b55c-20c41f0d3956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:28.791699 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-5721cc2b-5c06-4542-b55c-20c41f0d3956 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:06:28.793236 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-5721cc2b-5c06-4542-b55c-20c41f0d3956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:06:28.861649 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 475/981] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:06:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 04:06:28.884271 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8857589-92d3-4e8f-a61b-46fc45822ce6 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:28.932679 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:28.993775 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3b5bb-50bf-4144-aa34-47da7c726997 None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:28.994061 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3b5bb-50bf-4144-aa34-47da7c726997 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:28.994358 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3b5bb-50bf-4144-aa34-47da7c726997 None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:28.995892 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 476/982] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:06:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 18 04:06:29.000683 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8ca18-86ae-4c4c-9588-8f954fad1d47 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:29.000969 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8ca18-86ae-4c4c-9588-8f954fad1d47 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:29.001069 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8857589-92d3-4e8f-a61b-46fc45822ce6 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:29.001244 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8ca18-86ae-4c4c-9588-8f954fad1d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:29.019469 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-73e8ca18-86ae-4c4c-9588-8f954fad1d47 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:06:29.020549 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-73e8ca18-86ae-4c4c-9588-8f954fad1d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:06:29.045480 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe055df-d780-4a99-a74f-b36d1246ece7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:29.046737 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe055df-d780-4a99-a74f-b36d1246ece7 None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:29.047065 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe055df-d780-4a99-a74f-b36d1246ece7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:29.047476 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe055df-d780-4a99-a74f-b36d1246ece7 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:29.048314 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe055df-d780-4a99-a74f-b36d1246ece7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:29.050553 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe055df-d780-4a99-a74f-b36d1246ece7 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:29.065311 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 507/983] 10.222.0.20 () {60 vars in 1141 bytes} [Sat Jun 18 04:06:28 2022] POST /identity/v3/services => generated 242 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 04:06:29.109304 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 477/984] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:06:28 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 18 04:06:29.132932 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe055df-d780-4a99-a74f-b36d1246ece7 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:29.250536 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe055df-d780-4a99-a74f-b36d1246ece7 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:29.252106 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:29.287665 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a4ae0-4dc4-4a06-9bbe-3207d529fd11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:29.288399 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a4ae0-4dc4-4a06-9bbe-3207d529fd11 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:29.288698 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a4ae0-4dc4-4a06-9bbe-3207d529fd11 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:29.288972 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a4ae0-4dc4-4a06-9bbe-3207d529fd11 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:29.289633 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1a4ae0-4dc4-4a06-9bbe-3207d529fd11 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:29.291003 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1a4ae0-4dc4-4a06-9bbe-3207d529fd11 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:29.303397 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-4a1a4ae0-4dc4-4a06-9bbe-3207d529fd11 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 18 04:06:29.303397 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:29.303397 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 18 04:06:29.303397 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 18 04:06:29.303397 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 18 04:06:29.303397 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 18 04:06:29.303397 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 18 04:06:29.303397 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 04:06:29.303397 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 18 04:06:29.303397 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:29.303397 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 04:06:29.303397 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:29.303397 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:29.303397 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:29.303397 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:29.303397 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:29.303397 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:29.304379 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:29.304379 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:29.304379 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:29.304379 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:29.304379 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:29.304379 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:29.304379 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 18 04:06:29.304379 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 18 04:06:29.304379 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 18 04:06:29.304379 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 18 04:06:29.304379 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:29.304379 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:29.304379 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:29.304379 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:29.304379 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:29.304379 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:29.305366 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:29.305366 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:29.305366 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:29.305366 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:29.305366 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:29.305366 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:29.305366 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:29.305366 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:29.305366 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:29.305366 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:29.305366 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 18 04:06:29.305366 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 04:06:29.305366 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 18 04:06:29.305366 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:29.305366 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 508/985] 10.222.0.20 () {56 vars in 1126 bytes} [Sat Jun 18 04:06:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:29.311038 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e8ca18-86ae-4c4c-9588-8f954fad1d47 None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:29.347675 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:29.416116 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e8ca18-86ae-4c4c-9588-8f954fad1d47 None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:29.450714 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17bf683-8f2e-4945-bb5e-c63c455ea8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:29.451383 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17bf683-8f2e-4945-bb5e-c63c455ea8e2 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:29.451662 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17bf683-8f2e-4945-bb5e-c63c455ea8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:29.451934 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17bf683-8f2e-4945-bb5e-c63c455ea8e2 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:29.452663 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17bf683-8f2e-4945-bb5e-c63c455ea8e2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:29.452970 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17bf683-8f2e-4945-bb5e-c63c455ea8e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:29.454349 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17bf683-8f2e-4945-bb5e-c63c455ea8e2 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:29.459640 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 478/986] 10.222.0.20 () {56 vars in 1122 bytes} [Sat Jun 18 04:06:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:29.465278 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a4ae0-4dc4-4a06-9bbe-3207d529fd11 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:29.571351 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a4ae0-4dc4-4a06-9bbe-3207d529fd11 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:29.606886 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532bd11d-f4a1-4baa-92ca-a820b5d88238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:29.607558 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532bd11d-f4a1-4baa-92ca-a820b5d88238 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:29.607835 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532bd11d-f4a1-4baa-92ca-a820b5d88238 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:29.608106 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532bd11d-f4a1-4baa-92ca-a820b5d88238 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:29.609211 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532bd11d-f4a1-4baa-92ca-a820b5d88238 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:29.609515 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532bd11d-f4a1-4baa-92ca-a820b5d88238 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:29.610883 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532bd11d-f4a1-4baa-92ca-a820b5d88238 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:29.620611 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 509/987] 10.222.0.20 () {56 vars in 1122 bytes} [Sat Jun 18 04:06:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:29.621869 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17bf683-8f2e-4945-bb5e-c63c455ea8e2 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:29.724450 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:29.728232 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17bf683-8f2e-4945-bb5e-c63c455ea8e2 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:29.767010 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f162622-edff-4244-9ddb-83fcedecdfbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:29.767673 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f162622-edff-4244-9ddb-83fcedecdfbf None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:29.767948 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f162622-edff-4244-9ddb-83fcedecdfbf None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:29.768215 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f162622-edff-4244-9ddb-83fcedecdfbf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:29.769046 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f162622-edff-4244-9ddb-83fcedecdfbf None admin] RBAC: Adding query filter params (interface=admin, service_id=daef65ff6f1c45eba353652b0abecc9e, region_id=RegionOne) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:29.769359 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f162622-edff-4244-9ddb-83fcedecdfbf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:29.770715 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f162622-edff-4244-9ddb-83fcedecdfbf None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:29.780691 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 479/988] 10.222.0.20 () {56 vars in 1249 bytes} [Sat Jun 18 04:06:29 2022] GET /identity/v3/endpoints?service_id=daef65ff6f1c45eba353652b0abecc9e&interface=admin®ion_id=RegionOne => generated 193 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:06:29.781770 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532bd11d-f4a1-4baa-92ca-a820b5d88238 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:29.815297 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:29.886336 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532bd11d-f4a1-4baa-92ca-a820b5d88238 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:29.919383 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717ce34c-8fda-4980-81ca-b232c366f909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:29.920036 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ce34c-8fda-4980-81ca-b232c366f909 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:29.920304 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ce34c-8fda-4980-81ca-b232c366f909 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:29.920586 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ce34c-8fda-4980-81ca-b232c366f909 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:29.921338 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717ce34c-8fda-4980-81ca-b232c366f909 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:29.922698 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717ce34c-8fda-4980-81ca-b232c366f909 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:29.929220 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 510/989] 10.222.0.20 () {56 vars in 1087 bytes} [Sat Jun 18 04:06:29 2022] GET /identity/v3/services => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 04:06:30.560715 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01edbf-c233-45c6-ae8b-f504192b696a None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:30.560969 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01edbf-c233-45c6-ae8b-f504192b696a None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:30.561257 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01edbf-c233-45c6-ae8b-f504192b696a None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:30.562788 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 480/990] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:06:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:06:30.567928 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab509b9d-576c-4ab4-8eea-a2008ef7b708 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:30.568282 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab509b9d-576c-4ab4-8eea-a2008ef7b708 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:30.568657 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab509b9d-576c-4ab4-8eea-a2008ef7b708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:30.587255 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-ab509b9d-576c-4ab4-8eea-a2008ef7b708 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:06:30.588434 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-ab509b9d-576c-4ab4-8eea-a2008ef7b708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:06:30.664612 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 511/991] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:06:30 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 04:06:30.684853 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d01edbf-c233-45c6-ae8b-f504192b696a None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:30.791650 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d01edbf-c233-45c6-ae8b-f504192b696a None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:30.826083 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8954d-8114-4c77-a6f9-978a9f2f9f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:30.826790 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8954d-8114-4c77-a6f9-978a9f2f9f62 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:30.827064 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8954d-8114-4c77-a6f9-978a9f2f9f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:30.827327 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8954d-8114-4c77-a6f9-978a9f2f9f62 None admin] PATH_INFO: `/v3/services/image` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:30.827977 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf8954d-8114-4c77-a6f9-978a9f2f9f62 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:30.829375 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf8954d-8114-4c77-a6f9-978a9f2f9f62 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:30.840841 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-5bf8954d-8114-4c77-a6f9-978a9f2f9f62 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 18 04:06:30.840841 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:30.840841 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 18 04:06:30.840841 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 18 04:06:30.840841 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 18 04:06:30.840841 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 18 04:06:30.840841 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 18 04:06:30.840841 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 04:06:30.840841 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 18 04:06:30.840841 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:30.840841 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 04:06:30.840841 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:30.840841 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:30.840841 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:30.840841 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:30.840841 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:30.840841 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:30.841831 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:30.841831 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:30.841831 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:30.841831 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:30.841831 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:30.841831 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:30.841831 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 18 04:06:30.841831 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 18 04:06:30.841831 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 18 04:06:30.841831 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 18 04:06:30.841831 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:30.841831 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:30.841831 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:30.841831 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:30.841831 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:30.841831 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:30.842696 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:30.842696 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:30.842696 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:30.842696 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:30.842696 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:30.842696 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:30.842696 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:30.842696 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:30.842696 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:30.842696 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:30.842696 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 18 04:06:30.842696 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 04:06:30.842696 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 18 04:06:30.842696 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:30.844926 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 481/992] 10.222.0.20 () {56 vars in 1105 bytes} [Sat Jun 18 04:06:30 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:30.848048 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab509b9d-576c-4ab4-8eea-a2008ef7b708 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:30.875578 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:30.952170 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab509b9d-576c-4ab4-8eea-a2008ef7b708 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:30.992769 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff86ea38-1d3a-46a2-bc68-9a7baf3b7d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:30.993434 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86ea38-1d3a-46a2-bc68-9a7baf3b7d3e None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:30.993709 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86ea38-1d3a-46a2-bc68-9a7baf3b7d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:30.993976 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86ea38-1d3a-46a2-bc68-9a7baf3b7d3e None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:30.994686 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff86ea38-1d3a-46a2-bc68-9a7baf3b7d3e None admin] RBAC: Adding query filter params (name=image) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:30.994977 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff86ea38-1d3a-46a2-bc68-9a7baf3b7d3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:30.996335 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff86ea38-1d3a-46a2-bc68-9a7baf3b7d3e None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:31.005982 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 512/993] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:06:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:31.007763 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8954d-8114-4c77-a6f9-978a9f2f9f62 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:31.038915 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:31.111512 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a22e4-20d1-4810-b9b6-a808bab20d0e None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:31.111755 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a22e4-20d1-4810-b9b6-a808bab20d0e None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:31.112027 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a22e4-20d1-4810-b9b6-a808bab20d0e None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:31.113593 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 513/994] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:06:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:06:31.116557 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8954d-8114-4c77-a6f9-978a9f2f9f62 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:31.118720 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cac62d-48dc-448b-aeb1-322eb6c33de4 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:31.119234 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cac62d-48dc-448b-aeb1-322eb6c33de4 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:31.119509 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cac62d-48dc-448b-aeb1-322eb6c33de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:31.136078 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-f7cac62d-48dc-448b-aeb1-322eb6c33de4 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:06:31.137282 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-f7cac62d-48dc-448b-aeb1-322eb6c33de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:06:31.152248 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c1422a-dbcb-4893-95de-a6d0e0606988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:31.152947 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1422a-dbcb-4893-95de-a6d0e0606988 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:31.153221 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1422a-dbcb-4893-95de-a6d0e0606988 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:31.153489 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1422a-dbcb-4893-95de-a6d0e0606988 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:31.154213 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c1422a-dbcb-4893-95de-a6d0e0606988 None admin] RBAC: Adding query filter params (type=image) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:31.154515 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c1422a-dbcb-4893-95de-a6d0e0606988 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:31.155884 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c1422a-dbcb-4893-95de-a6d0e0606988 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:31.160551 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 482/995] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:06:31 2022] GET /identity/v3/services?type=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:31.214539 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 514/996] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:06:31 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 18 04:06:31.238219 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c1422a-dbcb-4893-95de-a6d0e0606988 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:31.340057 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:31.350653 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c1422a-dbcb-4893-95de-a6d0e0606988 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:31.385824 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e980f9-db1a-4129-b35f-a27f7e9906ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:31.386536 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e980f9-db1a-4129-b35f-a27f7e9906ef None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:31.386809 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e980f9-db1a-4129-b35f-a27f7e9906ef None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:31.387077 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e980f9-db1a-4129-b35f-a27f7e9906ef None admin] PATH_INFO: `/v3/services/compute` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:31.387785 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e980f9-db1a-4129-b35f-a27f7e9906ef None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:31.389224 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e980f9-db1a-4129-b35f-a27f7e9906ef None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:31.401037 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-b2e980f9-db1a-4129-b35f-a27f7e9906ef None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 18 04:06:31.401037 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:31.401037 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 18 04:06:31.401037 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 18 04:06:31.401037 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 18 04:06:31.401037 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 18 04:06:31.401037 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 18 04:06:31.401037 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 04:06:31.401037 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 18 04:06:31.401037 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:31.401037 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 04:06:31.401037 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:31.401037 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:31.401037 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:31.401037 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:31.401037 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:31.401037 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:31.402011 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:31.402011 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:31.402011 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:31.402011 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:31.402011 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:31.402011 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:31.402011 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 18 04:06:31.402011 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 18 04:06:31.402011 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 18 04:06:31.402011 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 18 04:06:31.402011 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:31.402011 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:31.402011 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:31.402011 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:31.402011 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:31.402011 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:31.403267 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:31.403267 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:31.403267 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:31.403267 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:31.403267 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:31.403267 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:31.403267 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:31.403267 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:31.403267 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:31.403267 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:31.403267 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 18 04:06:31.403267 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 04:06:31.403267 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 18 04:06:31.403267 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:31.403267 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 483/997] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Jun 18 04:06:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 04:06:31.408561 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cac62d-48dc-448b-aeb1-322eb6c33de4 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:31.427752 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:31.512075 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cac62d-48dc-448b-aeb1-322eb6c33de4 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:31.546657 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d5fe1-eb2d-4fc8-9ec7-3fe8c3d6602c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:31.547313 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d5fe1-eb2d-4fc8-9ec7-3fe8c3d6602c None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:31.547558 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d5fe1-eb2d-4fc8-9ec7-3fe8c3d6602c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:31.547852 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d5fe1-eb2d-4fc8-9ec7-3fe8c3d6602c None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:31.548557 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d5fe1-eb2d-4fc8-9ec7-3fe8c3d6602c None admin] RBAC: Adding query filter params (name=compute) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:31.548942 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d5fe1-eb2d-4fc8-9ec7-3fe8c3d6602c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:31.550301 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d5fe1-eb2d-4fc8-9ec7-3fe8c3d6602c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:31.555699 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 515/998] 10.222.0.20 () {56 vars in 1112 bytes} [Sat Jun 18 04:06:31 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:31.561211 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e980f9-db1a-4129-b35f-a27f7e9906ef None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:31.676268 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e980f9-db1a-4129-b35f-a27f7e9906ef None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:31.710746 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a3166-5717-4aa1-a744-bb7f63dfa703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:31.711429 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a3166-5717-4aa1-a744-bb7f63dfa703 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:31.711705 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a3166-5717-4aa1-a744-bb7f63dfa703 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:31.711973 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a3166-5717-4aa1-a744-bb7f63dfa703 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:31.712700 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1a3166-5717-4aa1-a744-bb7f63dfa703 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:31.712997 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1a3166-5717-4aa1-a744-bb7f63dfa703 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:31.714366 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1a3166-5717-4aa1-a744-bb7f63dfa703 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:31.719459 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 484/999] 10.222.0.20 () {56 vars in 1112 bytes} [Sat Jun 18 04:06:31 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:31.725331 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d5fe1-eb2d-4fc8-9ec7-3fe8c3d6602c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:31.816716 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:31.837106 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d5fe1-eb2d-4fc8-9ec7-3fe8c3d6602c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:31.873518 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b7142-d3e1-4cb7-abb8-d6776a7ee6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:31.874151 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b7142-d3e1-4cb7-abb8-d6776a7ee6a4 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:31.874412 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b7142-d3e1-4cb7-abb8-d6776a7ee6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:31.874702 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b7142-d3e1-4cb7-abb8-d6776a7ee6a4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:31.875493 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591b7142-d3e1-4cb7-abb8-d6776a7ee6a4 None admin] RBAC: Adding query filter params (interface=public, service_id=7dcdec7eae094c0c9a855e1e244cbb38, region_id=RegionOne) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:31.875801 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591b7142-d3e1-4cb7-abb8-d6776a7ee6a4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:31.877381 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591b7142-d3e1-4cb7-abb8-d6776a7ee6a4 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:31.887324 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 516/1000] 10.222.0.20 () {56 vars in 1251 bytes} [Sat Jun 18 04:06:31 2022] GET /identity/v3/endpoints?service_id=7dcdec7eae094c0c9a855e1e244cbb38&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:31.888943 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a3166-5717-4aa1-a744-bb7f63dfa703 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:31.914709 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:31.937028 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af609f7b-a283-4e5d-b37b-3c366d4e6efb None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:31.937320 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af609f7b-a283-4e5d-b37b-3c366d4e6efb None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:31.937601 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af609f7b-a283-4e5d-b37b-3c366d4e6efb None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:31.939130 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 517/1001] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:06:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:06:31.943761 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261cc70-847f-4d7c-9d82-9a8bc2022f55 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:31.944046 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261cc70-847f-4d7c-9d82-9a8bc2022f55 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:31.944326 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261cc70-847f-4d7c-9d82-9a8bc2022f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:31.964275 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-8261cc70-847f-4d7c-9d82-9a8bc2022f55 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:06:31.966436 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-8261cc70-847f-4d7c-9d82-9a8bc2022f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:06:32.014536 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a3166-5717-4aa1-a744-bb7f63dfa703 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:32.042437 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 518/1002] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:06:31 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 18 04:06:32.049538 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d65ff9-54b5-4989-905e-d5e4c37f2724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:32.050201 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d65ff9-54b5-4989-905e-d5e4c37f2724 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:32.050473 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d65ff9-54b5-4989-905e-d5e4c37f2724 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:32.050735 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d65ff9-54b5-4989-905e-d5e4c37f2724 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:32.051409 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d65ff9-54b5-4989-905e-d5e4c37f2724 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:32.052794 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d65ff9-54b5-4989-905e-d5e4c37f2724 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:32.060863 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 485/1003] 10.222.0.20 () {56 vars in 1087 bytes} [Sat Jun 18 04:06:31 2022] GET /identity/v3/services => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 04:06:32.068451 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8261cc70-847f-4d7c-9d82-9a8bc2022f55 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:32.157111 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:32.183137 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8261cc70-847f-4d7c-9d82-9a8bc2022f55 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:32.221987 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4815ef6-ecaf-46fb-bd74-ebbab40c3ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:32.222734 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4815ef6-ecaf-46fb-bd74-ebbab40c3ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:32.223011 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4815ef6-ecaf-46fb-bd74-ebbab40c3ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:32.223275 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4815ef6-ecaf-46fb-bd74-ebbab40c3ea7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:32.223937 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4815ef6-ecaf-46fb-bd74-ebbab40c3ea7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:32.226182 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4815ef6-ecaf-46fb-bd74-ebbab40c3ea7 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:32.238118 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application [None req-c4815ef6-ecaf-46fb-bd74-ebbab40c3ea7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 18 04:06:32.238118 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:32.238118 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 18 04:06:32.238118 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 18 04:06:32.238118 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 18 04:06:32.238118 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 18 04:06:32.238118 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 18 04:06:32.238118 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 04:06:32.238118 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 18 04:06:32.238118 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:32.238118 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 04:06:32.238118 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:32.238118 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:32.238118 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:32.238118 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:32.238118 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:32.238118 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:32.239133 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:32.239133 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:32.239133 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:32.239133 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:32.239133 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:32.239133 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:32.239133 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 18 04:06:32.239133 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 18 04:06:32.239133 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 18 04:06:32.239133 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 18 04:06:32.239133 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:32.239133 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:32.239133 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:32.239133 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:32.239133 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:32.239133 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:32.239966 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:32.239966 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:32.239966 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:32.239966 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:32.239966 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:32.239966 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:32.239966 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:32.239966 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:32.239966 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:32.239966 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:32.239966 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 18 04:06:32.239966 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 04:06:32.239966 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 18 04:06:32.239966 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: ERROR keystone.server.flask.application Jun 18 04:06:32.239966 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 519/1004] 10.222.0.20 () {56 vars in 1126 bytes} [Sat Jun 18 04:06:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 04:06:32.245837 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d65ff9-54b5-4989-905e-d5e4c37f2724 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:32.338364 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:32.356243 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d65ff9-54b5-4989-905e-d5e4c37f2724 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:32.390410 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41470b91-1d5f-48f8-9e72-11d52348bbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:32.391073 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41470b91-1d5f-48f8-9e72-11d52348bbd8 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:32.391356 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41470b91-1d5f-48f8-9e72-11d52348bbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:32.391631 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41470b91-1d5f-48f8-9e72-11d52348bbd8 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:32.392339 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41470b91-1d5f-48f8-9e72-11d52348bbd8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:32.392672 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41470b91-1d5f-48f8-9e72-11d52348bbd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:32.394053 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41470b91-1d5f-48f8-9e72-11d52348bbd8 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:32.399339 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 486/1005] 10.222.0.20 () {56 vars in 1122 bytes} [Sat Jun 18 04:06:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:32.404974 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4815ef6-ecaf-46fb-bd74-ebbab40c3ea7 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:32.511363 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4815ef6-ecaf-46fb-bd74-ebbab40c3ea7 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:32.546945 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e91b5f8-f54f-40c7-8db8-ff0714d50ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:32.547669 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91b5f8-f54f-40c7-8db8-ff0714d50ea4 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:32.547907 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91b5f8-f54f-40c7-8db8-ff0714d50ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:32.548260 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91b5f8-f54f-40c7-8db8-ff0714d50ea4 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:32.549000 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e91b5f8-f54f-40c7-8db8-ff0714d50ea4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:32.549305 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e91b5f8-f54f-40c7-8db8-ff0714d50ea4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:32.550664 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e91b5f8-f54f-40c7-8db8-ff0714d50ea4 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:32.556060 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 520/1006] 10.222.0.20 () {56 vars in 1122 bytes} [Sat Jun 18 04:06:32 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 04:06:32.561847 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41470b91-1d5f-48f8-9e72-11d52348bbd8 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:32.669459 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41470b91-1d5f-48f8-9e72-11d52348bbd8 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:32.704760 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bb256b-826d-4db4-bd6d-0b380ac702b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:32.705429 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb256b-826d-4db4-bd6d-0b380ac702b6 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:32.705724 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb256b-826d-4db4-bd6d-0b380ac702b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:32.706002 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb256b-826d-4db4-bd6d-0b380ac702b6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:32.706715 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bb256b-826d-4db4-bd6d-0b380ac702b6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:32.708101 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bb256b-826d-4db4-bd6d-0b380ac702b6 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:32.728624 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 487/1007] 10.222.0.20 () {60 vars in 1144 bytes} [Sat Jun 18 04:06:32 2022] POST /identity/v3/endpoints => generated 325 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 04:06:33.164819 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a07241-70b6-4925-878f-86f73d7f4e83 None None] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:33.165379 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a07241-70b6-4925-878f-86f73d7f4e83 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:33.165379 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a07241-70b6-4925-878f-86f73d7f4e83 None None] PATH_INFO: `/` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:33.167050 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 521/1008] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:06:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:06:33.172757 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c815342-f9be-4918-b21f-e7ece59746a4 None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:33.173319 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c815342-f9be-4918-b21f-e7ece59746a4 None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:33.173319 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c815342-f9be-4918-b21f-e7ece59746a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:33.191321 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-7c815342-f9be-4918-b21f-e7ece59746a4 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:06:33.192504 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-7c815342-f9be-4918-b21f-e7ece59746a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:06:33.194707 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:33.273265 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 488/1009] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:06:33 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 04:06:33.295950 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a07241-70b6-4925-878f-86f73d7f4e83 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:33.300961 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:33.402584 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a07241-70b6-4925-878f-86f73d7f4e83 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:33.435673 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2374f748-a0e1-414a-8f28-53dd96af013d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:33.436337 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374f748-a0e1-414a-8f28-53dd96af013d None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:33.436701 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374f748-a0e1-414a-8f28-53dd96af013d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:33.436976 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374f748-a0e1-414a-8f28-53dd96af013d None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:33.437711 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2374f748-a0e1-414a-8f28-53dd96af013d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:33.439070 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2374f748-a0e1-414a-8f28-53dd96af013d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:33.453968 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 522/1010] 10.222.0.20 () {60 vars in 1141 bytes} [Sat Jun 18 04:06:33 2022] POST /identity/v3/services => generated 242 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 04:06:34.088916 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09657622-b820-4e69-a788-73c3bfbfdb5c None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:34.089162 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09657622-b820-4e69-a788-73c3bfbfdb5c None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:34.089442 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09657622-b820-4e69-a788-73c3bfbfdb5c None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:34.090998 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 489/1011] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:06:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 04:06:34.096401 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b892a68-b441-4ab4-9aba-1b6dafd4c848 None None] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:34.096646 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b892a68-b441-4ab4-9aba-1b6dafd4c848 None None] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:34.096938 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b892a68-b441-4ab4-9aba-1b6dafd4c848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:34.114378 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.auth.core [None req-9b892a68-b441-4ab4-9aba-1b6dafd4c848 None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80240) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:06:34.115552 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.fernet_utils [None req-9b892a68-b441-4ab4-9aba-1b6dafd4c848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80240) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:06:34.175890 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:34.192234 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 523/1012] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:06:34 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 04:06:34.215600 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09657622-b820-4e69-a788-73c3bfbfdb5c None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:34.324449 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09657622-b820-4e69-a788-73c3bfbfdb5c None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:34.360194 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780acde-e635-426e-a6c1-e98aac48cb94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:34.361011 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780acde-e635-426e-a6c1-e98aac48cb94 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:34.361246 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780acde-e635-426e-a6c1-e98aac48cb94 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:34.361540 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780acde-e635-426e-a6c1-e98aac48cb94 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:34.362185 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d780acde-e635-426e-a6c1-e98aac48cb94 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:34.363547 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d780acde-e635-426e-a6c1-e98aac48cb94 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:34.365668 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:34.377140 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application [None req-d780acde-e635-426e-a6c1-e98aac48cb94 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 18 04:06:34.377140 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:34.377140 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 18 04:06:34.377140 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 18 04:06:34.377140 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 18 04:06:34.377140 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 18 04:06:34.377140 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 18 04:06:34.377140 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 04:06:34.377140 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 18 04:06:34.377140 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:34.377140 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 04:06:34.377140 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:34.377140 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 04:06:34.377140 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 04:06:34.377140 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 04:06:34.377140 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 04:06:34.377140 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 04:06:34.378158 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 04:06:34.378158 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 04:06:34.378158 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 04:06:34.378158 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 04:06:34.378158 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 04:06:34.378158 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 04:06:34.378158 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 18 04:06:34.378158 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 18 04:06:34.378158 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 18 04:06:34.378158 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 18 04:06:34.378158 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 04:06:34.378158 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 04:06:34.378158 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 04:06:34.378158 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 04:06:34.378158 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 04:06:34.378158 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 04:06:34.384125 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 04:06:34.384125 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application with Lock( Jun 18 04:06:34.384125 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 04:06:34.384125 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self._enter() Jun 18 04:06:34.384125 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 04:06:34.384125 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 04:06:34.384125 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 04:06:34.384125 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application return self.creator() Jun 18 04:06:34.384125 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 04:06:34.384125 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application created_value = creator( Jun 18 04:06:34.384125 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 18 04:06:34.384125 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 04:06:34.384125 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 18 04:06:34.384125 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: ERROR keystone.server.flask.application Jun 18 04:06:34.384125 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 490/1013] 10.222.0.20 () {56 vars in 1111 bytes} [Sat Jun 18 04:06:34 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 04:06:34.385256 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b892a68-b441-4ab4-9aba-1b6dafd4c848 None None] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:34.486379 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b892a68-b441-4ab4-9aba-1b6dafd4c848 None None] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:34.521493 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386520c-2361-4d8c-9a77-b2e76d9a79d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:34.522155 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386520c-2361-4d8c-9a77-b2e76d9a79d4 None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:34.522431 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386520c-2361-4d8c-9a77-b2e76d9a79d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:34.522701 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386520c-2361-4d8c-9a77-b2e76d9a79d4 None admin] PATH_INFO: `/v3/services` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:34.523389 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8386520c-2361-4d8c-9a77-b2e76d9a79d4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80240) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:34.523727 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8386520c-2361-4d8c-9a77-b2e76d9a79d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:34.525138 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8386520c-2361-4d8c-9a77-b2e76d9a79d4 None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:34.530419 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 524/1014] 10.222.0.20 () {56 vars in 1112 bytes} [Sat Jun 18 04:06:34 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:34.536065 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780acde-e635-426e-a6c1-e98aac48cb94 None admin] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:34.639739 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780acde-e635-426e-a6c1-e98aac48cb94 None admin] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:34.673043 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7361d9-54a9-4e7f-bcdc-a9cddea53d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:34.673699 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7361d9-54a9-4e7f-bcdc-a9cddea53d09 None admin] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:34.673975 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7361d9-54a9-4e7f-bcdc-a9cddea53d09 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:34.674240 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7361d9-54a9-4e7f-bcdc-a9cddea53d09 None admin] PATH_INFO: `/v3/services` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:34.674942 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7361d9-54a9-4e7f-bcdc-a9cddea53d09 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80241) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 04:06:34.675241 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7361d9-54a9-4e7f-bcdc-a9cddea53d09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:34.676608 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7361d9-54a9-4e7f-bcdc-a9cddea53d09 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:34.681566 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 491/1015] 10.222.0.20 () {56 vars in 1112 bytes} [Sat Jun 18 04:06:34 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:34.687229 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386520c-2361-4d8c-9a77-b2e76d9a79d4 None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:34.750585 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=100 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:34.772314 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c883d-f99f-47aa-b7be-6828b01a661e None None] REQUEST_METHOD: `GET` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:34.772626 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c883d-f99f-47aa-b7be-6828b01a661e None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:34.772900 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c883d-f99f-47aa-b7be-6828b01a661e None None] PATH_INFO: `/` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:34.774316 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 492/1016] 10.222.0.20 () {54 vars in 926 bytes} [Sat Jun 18 04:06:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 18 04:06:34.779231 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42baed0-1b6a-454d-82fc-9d3ae63a6d8c None None] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:34.779516 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42baed0-1b6a-454d-82fc-9d3ae63a6d8c None None] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:34.779788 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42baed0-1b6a-454d-82fc-9d3ae63a6d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:34.796324 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.auth.core [None req-b42baed0-1b6a-454d-82fc-9d3ae63a6d8c None None] MFA Rules not processed for user `7064955bb91f4385a8d5f4c522c8d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80241) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 04:06:34.797532 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.fernet_utils [None req-b42baed0-1b6a-454d-82fc-9d3ae63a6d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80241) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 04:06:34.800472 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386520c-2361-4d8c-9a77-b2e76d9a79d4 None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:34.835361 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db4696-0ec2-45dc-a1ce-986dff6ca90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:34.836027 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db4696-0ec2-45dc-a1ce-986dff6ca90c None admin] REQUEST_METHOD: `POST` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:34.836304 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db4696-0ec2-45dc-a1ce-986dff6ca90c None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:34.836595 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db4696-0ec2-45dc-a1ce-986dff6ca90c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:34.837344 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0db4696-0ec2-45dc-a1ce-986dff6ca90c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:34.838695 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0db4696-0ec2-45dc-a1ce-986dff6ca90c None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:34.854720 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=100 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:34.859985 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 525/1017] 10.222.0.20 () {60 vars in 1144 bytes} [Sat Jun 18 04:06:34 2022] POST /identity/v3/endpoints => generated 334 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 04:06:34.874487 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 493/1018] 10.222.0.20 () {58 vars in 1023 bytes} [Sat Jun 18 04:06:34 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 18 04:06:34.897997 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db4696-0ec2-45dc-a1ce-986dff6ca90c None admin] Authenticating user token {{(pid=80240) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:35.021516 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db4696-0ec2-45dc-a1ce-986dff6ca90c None admin] Validating token access rules against request {{(pid=80240) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:35.033192 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:35.060277 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b45687-a9a6-4f9f-a831-a847ae7a258d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80240) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:35.061367 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b45687-a9a6-4f9f-a831-a847ae7a258d None admin] REQUEST_METHOD: `GET` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:35.061775 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b45687-a9a6-4f9f-a831-a847ae7a258d None admin] SCRIPT_NAME: `/identity` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:35.062044 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b45687-a9a6-4f9f-a831-a847ae7a258d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80240) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:35.063588 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b45687-a9a6-4f9f-a831-a847ae7a258d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:35.065477 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b45687-a9a6-4f9f-a831-a847ae7a258d None admin] RBAC: Authorization granted {{(pid=80240) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:35.067123 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: [pid: 80240|app: 0|req: 526/1019] 10.222.0.20 () {56 vars in 1108 bytes} [Sat Jun 18 04:06:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 04:06:35.073336 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42baed0-1b6a-454d-82fc-9d3ae63a6d8c None None] Authenticating user token {{(pid=80241) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 04:06:35.179404 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42baed0-1b6a-454d-82fc-9d3ae63a6d8c None None] Validating token access rules against request {{(pid=80241) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 04:06:35.214776 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244a88d-8413-4adf-b751-33bb31f34cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7064955bb91f4385a8d5f4c522c8d511', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80241) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 04:06:35.215691 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244a88d-8413-4adf-b751-33bb31f34cc1 None admin] REQUEST_METHOD: `POST` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 04:06:35.216568 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244a88d-8413-4adf-b751-33bb31f34cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 04:06:35.217038 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244a88d-8413-4adf-b751-33bb31f34cc1 None admin] PATH_INFO: `/v3/projects` {{(pid=80241) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 04:06:35.217891 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c244a88d-8413-4adf-b751-33bb31f34cc1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 04:06:35.219539 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c244a88d-8413-4adf-b751-33bb31f34cc1 None admin] RBAC: Authorization granted {{(pid=80241) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 04:06:35.247249 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: [pid: 80241|app: 0|req: 494/1020] 10.222.0.20 () {60 vars in 1141 bytes} [Sat Jun 18 04:06:35 2022] POST /identity/v3/projects => generated 311 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 04:06:45.055506 dv-cinder-836996-34-iscsi devstack@keystone.service[80240]: DEBUG dbcounter [-] [80240] Writing DB stats keystone:SELECT=11 {{(pid=80240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 04:06:45.241675 dv-cinder-836996-34-iscsi devstack@keystone.service[80241]: DEBUG dbcounter [-] [80241] Writing DB stats keystone:SELECT=79,keystone:INSERT=1 {{(pid=80241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}